exec: [go test -json -tags=integ -timeout 180m ./tests/integration/telemetry/api -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts -test.skip TestCustomizeMetrics|TestDashboard/pilot-dashboard.json|TestStatsGatewayServerTCPFilter|TestImagePullPolicy/OCI_initial_creation_with_0.0.1|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2,_but_0.0.1_is_already_present_and_policy_is_IfNotPresent|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2,_but_0.0.1_is_already_present_and_policy_is_default|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2._0.0.1_is_already_present_but_policy_is_Always,_so_pull_0.0.2|TestGatewaySelection/OCI_initial_creation_with_latest_for_a_gateway|TestGatewaySelection/OCI_initial_creation_with_latest_for_a_gateway|TestImagePullPolicyWithHTTP] go test pid: 3323601 2025-12-09T09:14:41.535432Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T09:14:41.535488Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T09:14:41.567439Z info tf === Test Framework Settings === 2025-12-09T09:14:41.567518Z info tf TestID: telemetry_api RunID: 2ee7c67f-0966-4855-bc84-e0a77bace964 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T09:14:41.567524Z info tf =============================== 2025-12-09T09:14:41.580575Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-2ee7c67f09664855b 2025-12-09T09:14:41.580698Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T09:14:41.580716Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T09:14:41.580739Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-09T09:14:41.580748Z info tf === BEGIN: Building clusters === 2025-12-09T09:14:41.584820Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-09T09:14:41.584827Z info tf === DONE: Building clusters === 2025-12-09T09:14:41.584854Z info tf === BEGIN: Setup: 'telemetry_api' === 2025-12-09T09:14:41.584878Z info tf === BEGIN: Deploy Istio [Suite=telemetry_api] === 2025-12-09T09:14:41.584884Z info tf === Istio Component Config === 2025-12-09T09:14:41.584914Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.logging.level:xdsproxy:debug,wasm:debug global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T09:14:41.584918Z info tf ================================ 2025-12-09T09:14:41.587603Z info tf skipping deployment as specified in the config 2025-12-09T09:14:41.587616Z info tf === SUCCEEDED: Deploy Istio in 2.733643ms [Suite=telemetry_api]=== 2025-12-09T09:14:41.657505Z info tf === BEGIN: Deploy registry redirector server === 2025-12-09T09:14:41.657533Z info tf === BEGIN: Create namespace registry-redirector === 2025-12-09T09:14:41.824263Z info tf === SUCCEEDED: Create namespace registry-redirector in 166.7199ms === 2025-12-09T09:14:43.044838Z info tf Checking pods ready... 2025-12-09T09:14:43.044886Z info tf Checking pods ready... 2025-12-09T09:14:43.228064Z info tf No pods found... 2025-12-09T09:14:43.428818Z info tf Checking pods ready... 2025-12-09T09:14:43.428941Z info tf Checking pods ready... 2025-12-09T09:14:43.433004Z info tf No pods found... 2025-12-09T09:14:43.833842Z info tf Checking pods ready... 2025-12-09T09:14:43.833950Z info tf Checking pods ready... 2025-12-09T09:14:44.145884Z info tf [ 0] registry-redirector-7f6bd4c5df-f4crq Pending (Pending) 2025-12-09T09:14:44.946125Z info tf Checking pods ready... 2025-12-09T09:14:44.946194Z info tf Checking pods ready... 2025-12-09T09:14:45.043195Z info tf [ 0] registry-redirector-7f6bd4c5df-f4crq Pending (Pending) 2025-12-09T09:14:46.643795Z info tf Checking pods ready... 2025-12-09T09:14:46.643861Z info tf Checking pods ready... 2025-12-09T09:14:46.774008Z info tf [ 0] registry-redirector-7f6bd4c5df-f4crq Pending (Pending) 2025-12-09T09:14:49.974449Z info tf Checking pods ready... 2025-12-09T09:14:49.974531Z info tf Checking pods ready... 2025-12-09T09:14:49.993652Z info tf [ 0] registry-redirector-7f6bd4c5df-f4crq Running (Ready) 2025-12-09T09:14:50.025460Z info klog Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2025-12-09T09:14:50.025567Z info tf registry redirector server address: 172.30.146.196:1338 2025-12-09T09:14:50.074546Z info tf === SUCCEEDED: Deploy registry redirector server === 2025-12-09T09:14:50.074673Z info tf === BEGIN: Create namespace echo === 2025-12-09T09:14:50.074673Z info tf === BEGIN: Create namespace external === 2025-12-09T09:14:50.108411Z info tf === SUCCEEDED: Create namespace echo in 33.568701ms === 2025-12-09T09:14:50.115974Z info tf === SUCCEEDED: Create namespace external in 41.300985ms === 2025-12-09T09:14:50.380379Z info tf === BEGIN: Deploy echo instances === 2025-12-09T09:14:51.201450Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.205562Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.205837Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.209034Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.233880Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.241334Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.243602Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.245374Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.251190Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.257787Z info klog Waiting for caches to sync controller=echo 2025-12-09T09:14:51.302748Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.306474Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.306480Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.309962Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.334185Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.341504Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.344142Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.345583Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.352037Z info klog Caches are synced controller=echo 2025-12-09T09:14:51.358541Z info klog Caches are synced controller=echo 2025-12-09T09:15:04.051552Z info tf === SUCCEEDED: Deploy echo instances in 13.671154155s === 2025-12-09T09:15:04.321583Z info tf Checking pods ready... 2025-12-09T09:15:04.321659Z info tf Checking pods ready... 2025-12-09T09:15:04.331988Z info tf Failed retrieving pods: no matching pod found for selectors: [app.kubernetes.io/name=prometheus] 2025-12-09T09:15:04.532931Z info tf Checking pods ready... 2025-12-09T09:15:04.533047Z info tf Checking pods ready... 2025-12-09T09:15:04.539021Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:04.939871Z info tf Checking pods ready... 2025-12-09T09:15:04.939946Z info tf Checking pods ready... 2025-12-09T09:15:04.944130Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:05.744542Z info tf Checking pods ready... 2025-12-09T09:15:05.744676Z info tf Checking pods ready... 2025-12-09T09:15:05.748771Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:07.349282Z info tf Checking pods ready... 2025-12-09T09:15:07.349442Z info tf Checking pods ready... 2025-12-09T09:15:07.355036Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:10.555429Z info tf Checking pods ready... 2025-12-09T09:15:10.555479Z info tf Checking pods ready... 2025-12-09T09:15:10.559348Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:13.760357Z info tf Checking pods ready... 2025-12-09T09:15:13.760416Z info tf Checking pods ready... 2025-12-09T09:15:13.764859Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:16.965446Z info tf Checking pods ready... 2025-12-09T09:15:16.965500Z info tf Checking pods ready... 2025-12-09T09:15:16.975222Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:20.175787Z info tf Checking pods ready... 2025-12-09T09:15:20.175861Z info tf Checking pods ready... 2025-12-09T09:15:20.179801Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:23.380159Z info tf Checking pods ready... 2025-12-09T09:15:23.380206Z info tf Checking pods ready... 2025-12-09T09:15:23.385915Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Pending (Pending) 2025-12-09T09:15:26.586253Z info tf Checking pods ready... 2025-12-09T09:15:26.586319Z info tf Checking pods ready... 2025-12-09T09:15:26.590869Z info tf [ 0] prometheus-6fccd4f6dc-5pv86 Running (Ready) 2025-12-09T09:15:26.640009Z info tf === DONE: Setup: 'telemetry_api' (45.055141779s) === 2025-12-09T09:15:26.640064Z info tf === BEGIN: Test Run: 'telemetry_api' === PASS tests/integration/telemetry/api.TestAccessLogs/enabled (0.65s) PASS tests/integration/telemetry/api.TestAccessLogs/enabled-with-targetref (6.28s) PASS tests/integration/telemetry/api.TestAccessLogs/disabled (2.11s) PASS tests/integration/telemetry/api.TestAccessLogs (9.04s) PASS tests/integration/telemetry/api.TestAccessLogsFilter (3.73s) PASS tests/integration/telemetry/api.TestAccessLogsMode/client (11.58s) PASS tests/integration/telemetry/api.TestAccessLogsMode/server (11.46s) PASS tests/integration/telemetry/api.TestAccessLogsMode/client-and-server (11.27s) PASS tests/integration/telemetry/api.TestAccessLogsMode (34.31s) PASS tests/integration/telemetry/api.TestAccessLogsDefaultProvider/disabled (6.18s) PASS tests/integration/telemetry/api.TestAccessLogsDefaultProvider/enabled (1.51s) PASS tests/integration/telemetry/api.TestAccessLogsDefaultProvider (7.69s) PASS tests/integration/telemetry/api.TestAccessLogWithFilterState (0.57s) PASS tests/integration/telemetry/api.TestDashboard/istio-mesh-dashboard.json (0.05s) PASS tests/integration/telemetry/api.TestDashboard/istio-service-dashboard.json (0.26s) PASS tests/integration/telemetry/api.TestDashboard/istio-workload-dashboard.json (0.22s) PASS tests/integration/telemetry/api.TestDashboard/istio-performance-dashboard.json (8.44s) PASS tests/integration/telemetry/api.TestDashboard (9.80s) PASS tests/integration/telemetry/api.TestIstioctlMetrics (0.08s) PASS tests/integration/telemetry/api.TestStatsFilter/default (2.09s) === RUN TestStatsFilter/additional-labels 2025-12-09T09:16:33.951384Z info tf === BEGIN: Test: 'telemetry_api[TestStatsFilter/additional-labels]' === stats_test.go:142: query "istio_requests_total" returned 9 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 9 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 11 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 11 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 5 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:175: test failed: timeout while waiting after 40 attempts (last error: value not found (query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",})) 2025-12-09T09:17:53.971712Z info tf === DONE (failed): Test: 'telemetry_api[TestStatsFilter/additional-labels] (1m20.02032192s)' === 2025-12-09T09:17:53.971820Z error tf === Dumping Namespace external State for TestStatsFilter/additional-labels... 2025-12-09T09:17:53.971820Z error tf === Dumping Istio Deployment State for TestStatsFilter/additional-labels... 2025-12-09T09:17:53.971823Z error tf === Dumping Namespace registry-redirector State for TestStatsFilter/additional-labels... 2025-12-09T09:17:53.971881Z error tf === Dumping Namespace echo State for TestStatsFilter/additional-labels... 2025-12-09T09:17:54.270757Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:16:34Z/381cd94e88-7215-40c5-8e6f-df10a6cbbb8c 2025-12-09T09:17:54.270875Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2987s 2025-12-09T09:17:54.271613Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:17:54.383649Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:16:34Z/38b40d17b6-d117-4d17-a58b-197c70184b9e 2025-12-09T09:17:54.383751Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4116s 2025-12-09T09:17:54.384399Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:17:54.509404Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:16:34Z/38e0565247-cbbb-48f4-b7fc-e623bf6d936e 2025-12-09T09:17:54.509760Z info tf istioctl ([x internal-debug --all configz]): completed after 0.5375s 2025-12-09T09:17:54.510313Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestStatsFilter/additional-labels (81.53s) FAIL tests/integration/telemetry/api.TestStatsFilter/additional-labels (81.53s) PASS tests/integration/telemetry/api.TestStatsFilter/mockprom-to-metrics (0.07s) === RUN TestStatsFilter 2025-12-09T09:16:31.860282Z info tf === BEGIN: Test: 'telemetry_api[TestStatsFilter]' === 2025-12-09T09:17:55.546874Z info tf === DONE (failed): Test: 'telemetry_api[TestStatsFilter] (1m23.686584069s)' === 2025-12-09T09:17:55.546960Z error tf === Dumping Namespace external State for TestStatsFilter... 2025-12-09T09:17:55.546963Z error tf === Dumping Namespace registry-redirector State for TestStatsFilter... 2025-12-09T09:17:55.547010Z error tf === Dumping Istio Deployment State for TestStatsFilter... 2025-12-09T09:17:55.547002Z error tf === Dumping Namespace echo State for TestStatsFilter... 2025-12-09T09:17:55.806788Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:17:55Z/3964216d49-09de-418c-b64a-b8b0a37fdce2 2025-12-09T09:17:55.807082Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2597s 2025-12-09T09:17:55.807708Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:17:55.950684Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:17:55Z/39ab5e2c26-5dbc-4eca-843f-ef2966ac3ecd 2025-12-09T09:17:55.950869Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4035s 2025-12-09T09:17:55.951509Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:17:56.124159Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:17:55Z/3928ecc31b-ae16-4434-ab77-7f35eb8f7545 2025-12-09T09:17:56.124401Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5770s 2025-12-09T09:17:56.125391Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestStatsFilter (85.09s) FAIL tests/integration/telemetry/api.TestStatsFilter (85.09s) PASS tests/integration/telemetry/api.TestStatsTCPFilter/default (6.13s) === RUN TestStatsTCPFilter/additional-labels 2025-12-09T09:18:03.079697Z info tf === BEGIN: Test: 'telemetry_api[TestStatsTCPFilter/additional-labels]' === stats_test.go:214: query "istio_tcp_connections_opened_total" returned 3 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 3 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:227: test failed: timeout while waiting after 40 attempts (last error: value not found (query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",})) 2025-12-09T09:19:23.093215Z info tf === DONE (failed): Test: 'telemetry_api[TestStatsTCPFilter/additional-labels] (1m20.013513889s)' === 2025-12-09T09:19:23.093323Z error tf === Dumping Namespace external State for TestStatsTCPFilter/additional-labels... 2025-12-09T09:19:23.093322Z error tf === Dumping Istio Deployment State for TestStatsTCPFilter/additional-labels... 2025-12-09T09:19:23.093324Z error tf === Dumping Namespace registry-redirector State for TestStatsTCPFilter/additional-labels... 2025-12-09T09:19:23.093380Z error tf === Dumping Namespace echo State for TestStatsTCPFilter/additional-labels... 2025-12-09T09:19:23.282808Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:18:03Z/4024755e30-0dc7-4036-9a29-642c3c826829 2025-12-09T09:19:23.283310Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1897s 2025-12-09T09:19:23.283934Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:19:23.379228Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:18:03Z/40dd11f13a-a42e-4986-bcaa-5e8bc27a8a0b 2025-12-09T09:19:23.379415Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2858s 2025-12-09T09:19:23.380269Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:19:23.490770Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:18:03Z/40a2c0659c-5d34-4255-b734-5d5e4cbad79c 2025-12-09T09:19:23.490863Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3972s 2025-12-09T09:19:23.491732Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestStatsTCPFilter/additional-labels (81.71s) FAIL tests/integration/telemetry/api.TestStatsTCPFilter/additional-labels (81.71s) === RUN TestStatsTCPFilter 2025-12-09T09:17:56.948375Z info tf === BEGIN: Test: 'telemetry_api[TestStatsTCPFilter]' === 2025-12-09T09:19:24.789689Z info tf === DONE (failed): Test: 'telemetry_api[TestStatsTCPFilter] (1m27.841303356s)' === 2025-12-09T09:19:24.789871Z error tf === Dumping Namespace external State for TestStatsTCPFilter... 2025-12-09T09:19:24.789886Z error tf === Dumping Namespace echo State for TestStatsTCPFilter... 2025-12-09T09:19:24.789873Z error tf === Dumping Namespace registry-redirector State for TestStatsTCPFilter... 2025-12-09T09:19:24.789901Z error tf === Dumping Istio Deployment State for TestStatsTCPFilter... 2025-12-09T09:19:25.074460Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:19:24Z/418fee20c1-ec92-4f87-9049-372b3346dbd0 2025-12-09T09:19:25.074775Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2846s 2025-12-09T09:19:25.075551Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:19:25.212468Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:19:24Z/41850e18f3-2907-4181-bd14-fbcc9ce0cd32 2025-12-09T09:19:25.212592Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4224s 2025-12-09T09:19:25.213487Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:19:25.334246Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:19:24Z/4103f694f1-4e8e-43fe-bbf6-b5f4af7bd0de 2025-12-09T09:19:25.334405Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5442s 2025-12-09T09:19:25.335133Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF --- FAIL: TestStatsTCPFilter (89.51s) FAIL tests/integration/telemetry/api.TestStatsTCPFilter (89.51s) PASS tests/integration/telemetry/api.TestGRPCCountMetrics/istio_request_messages_total (1.09s) PASS tests/integration/telemetry/api.TestGRPCCountMetrics/istio_response_messages_total (0.03s) PASS tests/integration/telemetry/api.TestGRPCCountMetrics (1.12s) PASS tests/integration/telemetry/api.TestImagePullPolicy/Delete_WasmPlugin_wasm-test-module (0.04s) PASS tests/integration/telemetry/api.TestImagePullPolicy/Delete_WasmPlugin_wasm-test-module#01 (0.02s) PASS tests/integration/telemetry/api.TestImagePullPolicy (0.06s) PASS tests/integration/telemetry/api.TestGatewaySelection/Delete_WasmPlugin_wasm-test-module (0.02s) PASS tests/integration/telemetry/api.TestGatewaySelection (0.10s) PASS tests/integration/telemetry/api.TestImagePullPolicyWithHTTP (0.00s) PASS tests/integration/telemetry/api.TestBadWasmRemoteLoad (8.19s) PASS tests/integration/telemetry/api.TestBadWasmWithFailOpen (28.13s) 2025-12-09T09:20:04.060528Z info tf === FAILED: Test Run: 'telemetry_api' (exitCode: 1) === 2025-12-09T09:20:04.060572Z info tf === Suite "telemetry_api" run time: 5m22.475724135s === 2025-12-09T09:20:04.060596Z info tf Wrote trace to /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/trace.yaml 2025-12-09T09:20:04.061556Z error tf === Dumping Namespace external State for [suite(telemetry_api)]... 2025-12-09T09:20:04.061571Z error tf === Dumping Namespace echo State for [suite(telemetry_api)]... 2025-12-09T09:20:04.061556Z error tf === Dumping Namespace registry-redirector State for [suite(telemetry_api)]... 2025-12-09T09:20:04.061604Z error tf === Dumping Istio Deployment State for [suite(telemetry_api)]... 2025-12-09T09:20:04.273107Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:20:04Z/45f059bd65-e98b-4f32-bc1c-70a043ecdce5 2025-12-09T09:20:04.273434Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2114s 2025-12-09T09:20:04.274311Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:20:04.377009Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:20:04Z/45c4278b99-2257-49d4-bdc7-72f44b41923e 2025-12-09T09:20:04.377115Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.3151s 2025-12-09T09:20:04.377821Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:20:04.480470Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:20:04Z/457bfdae61-efef-4882-9d01-80e307b8dd1a 2025-12-09T09:20:04.480573Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4186s 2025-12-09T09:20:04.481296Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:20:06.183129Z info tf === BEGIN: Cleanup Istio [Suite=telemetry_api] === 2025-12-09T09:20:06.183256Z info tf === SUCCEEDED: Cleanup Istio in 116.945µs [Suite=telemetry_api] === FAIL tests/integration/telemetry/api DONE 37 tests, 4 failures in 324.687s exec: [go test -json -test.run=^TestStatsFilter$/^additional-labels$ -tags=integ -timeout 180m istio.io/istio/tests/integration/telemetry/api -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts -test.skip TestCustomizeMetrics|TestDashboard/pilot-dashboard.json|TestStatsGatewayServerTCPFilter|TestImagePullPolicy/OCI_initial_creation_with_0.0.1|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2,_but_0.0.1_is_already_present_and_policy_is_IfNotPresent|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2,_but_0.0.1_is_already_present_and_policy_is_default|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2._0.0.1_is_already_present_but_policy_is_Always,_so_pull_0.0.2|TestGatewaySelection/OCI_initial_creation_with_latest_for_a_gateway|TestGatewaySelection/OCI_initial_creation_with_latest_for_a_gateway|TestImagePullPolicyWithHTTP] go test pid: 3326117 2025-12-09T09:20:18.284316Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T09:20:18.284376Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T09:20:18.316979Z info tf === Test Framework Settings === 2025-12-09T09:20:18.317097Z info tf TestID: telemetry_api RunID: 69234dc3-9efe-43a4-927e-42a3c5b65ff0 NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T09:20:18.317104Z info tf =============================== 2025-12-09T09:20:18.317523Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-69234dc39efe43a49 2025-12-09T09:20:18.317662Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T09:20:18.317691Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T09:20:18.317726Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-09T09:20:18.317744Z info tf === BEGIN: Building clusters === 2025-12-09T09:20:18.322889Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-09T09:20:18.322899Z info tf === DONE: Building clusters === 2025-12-09T09:20:18.322932Z info tf === BEGIN: Setup: 'telemetry_api' === 2025-12-09T09:20:18.322963Z info tf === BEGIN: Deploy Istio [Suite=telemetry_api] === 2025-12-09T09:20:18.322971Z info tf === Istio Component Config === 2025-12-09T09:20:18.323009Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.logging.level:xdsproxy:debug,wasm:debug global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T09:20:18.323015Z info tf ================================ 2025-12-09T09:20:18.326477Z info tf skipping deployment as specified in the config 2025-12-09T09:20:18.326498Z info tf === SUCCEEDED: Deploy Istio in 3.527504ms [Suite=telemetry_api]=== 2025-12-09T09:20:18.563036Z info tf === BEGIN: Deploy registry redirector server === 2025-12-09T09:20:18.563088Z info tf === BEGIN: Create namespace registry-redirector === 2025-12-09T09:20:18.915231Z info tf === SUCCEEDED: Create namespace registry-redirector in 352.111109ms === 2025-12-09T09:20:19.119937Z info tf === SUCCEEDED: Deploy registry redirector server === 2025-12-09T09:20:19.120026Z error tf === Dumping Namespace registry-redirector State for [suite(telemetry_api)]... 2025-12-09T09:20:19.120034Z error tf === Dumping Istio Deployment State for [suite(telemetry_api)]... 2025-12-09T09:20:19.274127Z error tf Test setup error: failed to apply rendered /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/pkg/test/framework/components/registryredirector/registry_redirector_server.yaml, err: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-69234dc39efe43a49/_suite_context/Deployment-Service.1468570260.yaml] to ns registry-redirector in cluster cluster-0: apply: patch: services "registry-redirector" is forbidden: unable to create new content in namespace registry-redirector because it is being terminated 2025-12-09T09:20:19.274202Z info tf === FAILED: Setup: 'telemetry_api' (failed to apply rendered /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/pkg/test/framework/components/registryredirector/registry_redirector_server.yaml, err: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-69234dc39efe43a49/_suite_context/Deployment-Service.1468570260.yaml] to ns registry-redirector in cluster cluster-0: apply: patch: services "registry-redirector" is forbidden: unable to create new content in namespace registry-redirector because it is being terminated) === 2025-12-09T09:20:19.274212Z error tf Exiting due to setup failure: failed to apply rendered /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/pkg/test/framework/components/registryredirector/registry_redirector_server.yaml, err: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-69234dc39efe43a49/_suite_context/Deployment-Service.1468570260.yaml] to ns registry-redirector in cluster cluster-0: apply: patch: services "registry-redirector" is forbidden: unable to create new content in namespace registry-redirector because it is being terminated 2025-12-09T09:20:19.274255Z error tf === Dumping Namespace registry-redirector State for [suite(telemetry_api)]... 2025-12-09T09:20:19.274274Z error tf === Dumping Istio Deployment State for [suite(telemetry_api)]... 2025-12-09T09:20:19.550451Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:20:18Z/490c57c4be-5609-4135-9313-69b5d42f01aa 2025-12-09T09:20:19.550599Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4302s 2025-12-09T09:20:19.551742Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:20:20.120573Z info tf === BEGIN: Cleanup Istio [Suite=telemetry_api] === 2025-12-09T09:20:20.120655Z info tf === SUCCEEDED: Cleanup Istio in 74.849µs [Suite=telemetry_api] === FAIL tests/integration/telemetry/api exec: [go test -json -test.run=^TestStatsTCPFilter$/^additional-labels$ -tags=integ -timeout 180m istio.io/istio/tests/integration/telemetry/api -args -istio.test.skipWorkloads=tproxy,vm -istio.test.openshift -istio.test.kube.helm.values=global.platform=openshift -istio.test.istio.enableCNI=true -istio.test.ci=true -istio.test.env=kube -istio.test.kube.deploy=false -istio.test.stableNamespaces=true -istio.test.kube.deployGatewayAPI=false -istio.test.gatewayConformance.maxTimeToConsistency=180s -istio.test.work_dir=/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts -test.skip TestCustomizeMetrics|TestDashboard/pilot-dashboard.json|TestStatsGatewayServerTCPFilter|TestImagePullPolicy/OCI_initial_creation_with_0.0.1|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2,_but_0.0.1_is_already_present_and_policy_is_IfNotPresent|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2,_but_0.0.1_is_already_present_and_policy_is_default|TestImagePullPolicy/OCI_upstream_is_upgraded_to_0.0.2._0.0.1_is_already_present_but_policy_is_Always,_so_pull_0.0.2|TestGatewaySelection/OCI_initial_creation_with_latest_for_a_gateway|TestGatewaySelection/OCI_initial_creation_with_latest_for_a_gateway|TestImagePullPolicyWithHTTP] go test pid: 3327161 2025-12-09T09:20:33.204780Z warn unable to resolve TARGET_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T09:20:33.204859Z warn unable to resolve LOCAL_OUT. Dir /root/anurag/ossm3.x/istio-integration-test/istio-integration-3.1.4/istio/out/linux_ppc64le does not exist 2025-12-09T09:20:33.234499Z info tf === Test Framework Settings === 2025-12-09T09:20:33.234641Z info tf TestID: telemetry_api RunID: 1695ccde-db14-47b5-becb-81599a1d105b NoCleanup: false BaseDir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts Selector: FailOnDeprecation: false CIMode: true Retries: 0 StableNamespaces: true Revision: SkipWorkloads [tproxy vm] Compatibility: false Revisions: Hub: quay.io/maistra Tag: ibm-p Variant: PullPolicy: Always PullSecret: MaxDumps: 10 HelmRepo: https://istio-release.storage.googleapis.com/charts IPFamilies: [] GatewayConformanceStandardOnly: false GatewayConformanceAllowCRDsMismatch: false 2025-12-09T09:20:33.234658Z info tf =============================== 2025-12-09T09:20:33.235835Z info tf Test run dir: /home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-1695ccdedb1447b5b 2025-12-09T09:20:33.236089Z info tf Test Framework Kubernetes environment Settings: Kubeconfigs: [] LoadBalancerSupported: true MCSControllerEnabled: false ControlPlaneTopology: map[] NetworkTopology: map[] ConfigTopology: map[] 2025-12-09T09:20:33.236110Z info tf Flags istio.test.kube.config and istio.test.kube.topology not specified. 2025-12-09T09:20:33.236130Z info tf Using KubeConfigs: [/root/upi/cC/auth/kubeconfig]. 2025-12-09T09:20:33.236139Z info tf === BEGIN: Building clusters === 2025-12-09T09:20:33.239971Z info tf Built Cluster: Name: cluster-0 StableName: primary-0 PrimaryCluster: cluster-0 ConfigCluster: cluster-0 Network: HTTPProxy: ProxyKubectlOnly: false Filename: /root/upi/cC/auth/kubeconfig 2025-12-09T09:20:33.239980Z info tf === DONE: Building clusters === 2025-12-09T09:20:33.239998Z info tf === BEGIN: Setup: 'telemetry_api' === 2025-12-09T09:20:33.240022Z info tf === BEGIN: Deploy Istio [Suite=telemetry_api] === 2025-12-09T09:20:33.240027Z info tf === Istio Component Config === 2025-12-09T09:20:33.240056Z info tf SystemNamespace: istio-system TelemetryNamespace: istio-system DeployIstio: false DeployEastWestGW: true Values: map[global.hub:quay.io/maistra global.imagePullPolicy:Always global.logging.level:xdsproxy:debug,wasm:debug global.platform:openshift global.tag:ibm-p global.variant:] PrimaryClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml ConfigClusterIOPFile: tests/integration/iop-integration-test-defaults.yaml RemoteClusterIOPFile: tests/integration/iop-remote-integration-test-defaults.yaml BaseIOPFile: tests/integration/base.yaml SkipWaitForValidationWebhook: false DumpKubernetesManifests: false IstiodlessRemotes: true OperatorOptions: map[] EnableCNI: true IngressGatewayServiceName: IngressGatewayServiceNamespace: IngressGatewayIstioLabel: EgressGatewayServiceName: istio-egressgateway EgressGatewayServiceNamespace: istio-system EgressGatewayIstioLabel: egressgateway SharedMeshConfigName: ControlPlaneInstaller: 2025-12-09T09:20:33.240062Z info tf ================================ 2025-12-09T09:20:33.242692Z info tf skipping deployment as specified in the config 2025-12-09T09:20:33.242707Z info tf === SUCCEEDED: Deploy Istio in 2.682107ms [Suite=telemetry_api]=== 2025-12-09T09:20:33.272099Z info tf === BEGIN: Deploy registry redirector server === 2025-12-09T09:20:33.272144Z info tf === BEGIN: Create namespace registry-redirector === 2025-12-09T09:20:33.291933Z info tf === SUCCEEDED: Create namespace registry-redirector in 19.783833ms === 2025-12-09T09:20:33.422412Z info tf Checking pods ready... 2025-12-09T09:20:33.422447Z info tf Checking pods ready... 2025-12-09T09:20:33.446690Z info tf No pods found... 2025-12-09T09:20:33.647490Z info tf Checking pods ready... 2025-12-09T09:20:33.647533Z info tf Checking pods ready... 2025-12-09T09:20:33.652457Z info tf [ 0] registry-redirector-7f6bd4c5df-s8pfr Pending (Pending) 2025-12-09T09:20:34.053325Z info tf Checking pods ready... 2025-12-09T09:20:34.053425Z info tf Checking pods ready... 2025-12-09T09:20:34.062772Z info tf [ 0] registry-redirector-7f6bd4c5df-s8pfr Pending (Pending) 2025-12-09T09:20:34.863826Z info tf Checking pods ready... 2025-12-09T09:20:34.863881Z info tf Checking pods ready... 2025-12-09T09:20:34.868007Z info tf [ 0] registry-redirector-7f6bd4c5df-s8pfr Pending (Pending) 2025-12-09T09:20:36.468675Z info tf Checking pods ready... 2025-12-09T09:20:36.468712Z info tf Checking pods ready... 2025-12-09T09:20:36.472513Z info tf [ 0] registry-redirector-7f6bd4c5df-s8pfr Running (Ready) 2025-12-09T09:20:36.480235Z info klog Warning: v1 Endpoints is deprecated in v1.33+; use discovery.k8s.io/v1 EndpointSlice 2025-12-09T09:20:36.480318Z info tf registry redirector server address: 172.30.93.62:1338 2025-12-09T09:20:36.512550Z info tf === SUCCEEDED: Deploy registry redirector server === 2025-12-09T09:20:36.512687Z info tf === BEGIN: Create namespace external === 2025-12-09T09:20:36.512716Z info tf === BEGIN: Create namespace echo === 2025-12-09T09:20:36.520534Z info tf === SUCCEEDED: Create namespace echo in 7.833517ms === 2025-12-09T09:20:36.531515Z info tf === SUCCEEDED: Create namespace external in 18.831052ms === 2025-12-09T09:20:36.709422Z info tf === BEGIN: Deploy echo instances === 2025-12-09T09:20:36.786385Z error tf === FAILED: Deploy echo instances === 2025-12-09T09:20:36.786475Z error tf failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-1695ccdedb1447b5b/_suite_context/ServiceAccount-Service.760166523.yaml] to ns echo in cluster cluster-0: apply: patch: services "headless" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-09T09:20:36.786541Z error tf === Dumping Namespace echo State for [suite(telemetry_api)]... 2025-12-09T09:20:36.786579Z error tf === Dumping Istio Deployment State for [suite(telemetry_api)]... 2025-12-09T09:20:36.786550Z error tf === Dumping Namespace registry-redirector State for [suite(telemetry_api)]... 2025-12-09T09:20:36.786639Z error tf === Dumping Namespace external State for [suite(telemetry_api)]... 2025-12-09T09:20:37.218931Z error tf Test setup error: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-1695ccdedb1447b5b/_suite_context/ServiceAccount-Service.760166523.yaml] to ns echo in cluster cluster-0: apply: patch: services "headless" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-09T09:20:37.219000Z info tf === FAILED: Setup: 'telemetry_api' (failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-1695ccdedb1447b5b/_suite_context/ServiceAccount-Service.760166523.yaml] to ns echo in cluster cluster-0: apply: patch: services "headless" is forbidden: unable to create new content in namespace echo because it is being terminated) === 2025-12-09T09:20:37.219012Z error tf Exiting due to setup failure: failed applying YAML files [/home/jenkins/workspace/sail/istio-integration-tests-suites/telemetry-api/artifacts/telemetry-api-1695ccdedb1447b5b/_suite_context/ServiceAccount-Service.760166523.yaml] to ns echo in cluster cluster-0: apply: patch: services "headless" is forbidden: unable to create new content in namespace echo because it is being terminated 2025-12-09T09:20:37.219055Z error tf === Dumping Namespace echo State for [suite(telemetry_api)]... 2025-12-09T09:20:37.219070Z error tf === Dumping Namespace external State for [suite(telemetry_api)]... 2025-12-09T09:20:37.219088Z error tf === Dumping Istio Deployment State for [suite(telemetry_api)]... 2025-12-09T09:20:37.219063Z error tf === Dumping Namespace registry-redirector State for [suite(telemetry_api)]... 2025-12-09T09:20:37.242950Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:20:36Z/57f564e400-6f14-48d2-9250-d5f12d2cadb3 2025-12-09T09:20:37.243253Z info tf istioctl ([x internal-debug --all configz]): completed after 0.4562s 2025-12-09T09:20:37.244961Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:20:37.503060Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:20:36Z/57544eeb1d-c17c-4975-b5ec-ed29a53ae3bd 2025-12-09T09:20:37.503157Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.7161s 2025-12-09T09:20:37.503963Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:20:37.640326Z info tf === BEGIN: Cleanup Istio [Suite=telemetry_api] === 2025-12-09T09:20:37.640446Z info tf === SUCCEEDED: Cleanup Istio in 111.465µs [Suite=telemetry_api] === FAIL tests/integration/telemetry/api === Failed === FAIL: tests/integration/telemetry/api TestStatsFilter/additional-labels (81.53s) 2025-12-09T09:16:33.951384Z info tf === BEGIN: Test: 'telemetry_api[TestStatsFilter/additional-labels]' === stats_test.go:142: query "istio_requests_total" returned 9 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 9 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 11 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 11 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 12 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: istio-system/istio-ingressgateway-5754586674-dv5p6) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [source_version upstream_custom_label] stats_test.go:142: Series 5 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 6 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: Series 7 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 8 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: missing labels: [upstream_custom_label source_version] stats_test.go:142: Series 9 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 10 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "response_code", wanted "200" but got "418" stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 11 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "source_workload", wanted "a-v1" but got "istio-ingressgateway" stats_test.go:142: for label "source_version", wanted "v1" but got "unknown" stats_test.go:142: for label "source_app", wanted "a" but got "istio-ingressgateway" stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: for label "source_workload_namespace", wanted "echo" but got "istio-system" stats_test.go:142: for label "response_code", wanted "200" but got "520" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: query "istio_requests_total" returned 5 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 2 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 4 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: query "istio_requests_total" returned 3 series, but none matched our query exactly. stats_test.go:142: Original query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",} stats_test.go:142: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:142: for label "reporter", wanted "source" but got "destination" stats_test.go:142: missing labels: [upstream_custom_label] stats_test.go:142: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:142: for label "destination_version", wanted "v1" but got "unknown" stats_test.go:142: for label "destination_service_name", wanted "b" but got "naked" stats_test.go:142: for label "destination_service", wanted "b.echo.svc.cluster.local" but got "naked.echo.svc.cluster.local" stats_test.go:142: for label "upstream_custom_label", wanted "b" but got "unknown" stats_test.go:142: for label "destination_app", wanted "b" but got "unknown" stats_test.go:175: test failed: timeout while waiting after 40 attempts (last error: value not found (query: istio_requests_total{destination_app="b",destination_service="b.echo.svc.cluster.local",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",reporter="source",request_protocol="http",response_code="200",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",upstream_custom_label="b",})) 2025-12-09T09:17:53.971712Z info tf === DONE (failed): Test: 'telemetry_api[TestStatsFilter/additional-labels] (1m20.02032192s)' === 2025-12-09T09:17:53.971820Z error tf === Dumping Namespace external State for TestStatsFilter/additional-labels... 2025-12-09T09:17:53.971820Z error tf === Dumping Istio Deployment State for TestStatsFilter/additional-labels... 2025-12-09T09:17:53.971823Z error tf === Dumping Namespace registry-redirector State for TestStatsFilter/additional-labels... 2025-12-09T09:17:53.971881Z error tf === Dumping Namespace echo State for TestStatsFilter/additional-labels... 2025-12-09T09:17:54.270757Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:16:34Z/381cd94e88-7215-40c5-8e6f-df10a6cbbb8c 2025-12-09T09:17:54.270875Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2987s 2025-12-09T09:17:54.271613Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:17:54.383649Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:16:34Z/38b40d17b6-d117-4d17-a58b-197c70184b9e 2025-12-09T09:17:54.383751Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.4116s 2025-12-09T09:17:54.384399Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:17:54.509404Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:16:34Z/38e0565247-cbbb-48f4-b7fc-e623bf6d936e 2025-12-09T09:17:54.509760Z info tf istioctl ([x internal-debug --all configz]): completed after 0.5375s 2025-12-09T09:17:54.510313Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/telemetry/api TestStatsFilter (85.09s) 2025-12-09T09:16:31.860282Z info tf === BEGIN: Test: 'telemetry_api[TestStatsFilter]' === 2025-12-09T09:17:55.546874Z info tf === DONE (failed): Test: 'telemetry_api[TestStatsFilter] (1m23.686584069s)' === 2025-12-09T09:17:55.546960Z error tf === Dumping Namespace external State for TestStatsFilter... 2025-12-09T09:17:55.546963Z error tf === Dumping Namespace registry-redirector State for TestStatsFilter... 2025-12-09T09:17:55.547010Z error tf === Dumping Istio Deployment State for TestStatsFilter... 2025-12-09T09:17:55.547002Z error tf === Dumping Namespace echo State for TestStatsFilter... 2025-12-09T09:17:55.806788Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:17:55Z/3964216d49-09de-418c-b64a-b8b0a37fdce2 2025-12-09T09:17:55.807082Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2597s 2025-12-09T09:17:55.807708Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:17:55.950684Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:17:55Z/39ab5e2c26-5dbc-4eca-843f-ef2966ac3ecd 2025-12-09T09:17:55.950869Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4035s 2025-12-09T09:17:55.951509Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:17:56.124159Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:17:55Z/3928ecc31b-ae16-4434-ab77-7f35eb8f7545 2025-12-09T09:17:56.124401Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5770s 2025-12-09T09:17:56.125391Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/telemetry/api TestStatsTCPFilter/additional-labels (81.71s) 2025-12-09T09:18:03.079697Z info tf === BEGIN: Test: 'telemetry_api[TestStatsTCPFilter/additional-labels]' === stats_test.go:214: query "istio_tcp_connections_opened_total" returned 3 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 3 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 5 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 4 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "source_cluster", wanted "Kubernetes" but got "unknown" stats_test.go:214: for label "source_version", wanted "v1" but got "unknown" stats_test.go:214: for label "destination_service_name", wanted "b" but got "InboundPassthroughCluster" stats_test.go:214: for label "source_workload", wanted "a-v1" but got "unknown" stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: for label "source_app", wanted "a" but got "unknown" stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 4 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 1 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 2 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: Series 3 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:214: query "istio_tcp_connections_opened_total" returned 2 series, but none matched our query exactly. stats_test.go:214: Original query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",} stats_test.go:214: Series 0 (source: echo/b-v1-7776fdd6d8-qshb2) stats_test.go:214: for label "downstream_custom_label", wanted "a" but got "unknown" stats_test.go:214: Series 1 (source: echo/a-v1-5654f5f785-gq9ct) stats_test.go:214: for label "reporter", wanted "destination" but got "source" stats_test.go:214: missing labels: [downstream_custom_label] stats_test.go:227: test failed: timeout while waiting after 40 attempts (last error: value not found (query: istio_tcp_connections_opened_total{destination_app="b",destination_canonical_revision="v1",destination_canonical_service="b",destination_service_name="b",destination_service_namespace="echo",destination_version="v1",destination_workload_namespace="echo",downstream_custom_label="a",reporter="destination",request_protocol="tcp",source_app="a",source_cluster="Kubernetes",source_version="v1",source_workload="a-v1",source_workload_namespace="echo",})) 2025-12-09T09:19:23.093215Z info tf === DONE (failed): Test: 'telemetry_api[TestStatsTCPFilter/additional-labels] (1m20.013513889s)' === 2025-12-09T09:19:23.093323Z error tf === Dumping Namespace external State for TestStatsTCPFilter/additional-labels... 2025-12-09T09:19:23.093322Z error tf === Dumping Istio Deployment State for TestStatsTCPFilter/additional-labels... 2025-12-09T09:19:23.093324Z error tf === Dumping Namespace registry-redirector State for TestStatsTCPFilter/additional-labels... 2025-12-09T09:19:23.093380Z error tf === Dumping Namespace echo State for TestStatsTCPFilter/additional-labels... 2025-12-09T09:19:23.282808Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:18:03Z/4024755e30-0dc7-4036-9a29-642c3c826829 2025-12-09T09:19:23.283310Z info tf istioctl ([x internal-debug --all configz]): completed after 0.1897s 2025-12-09T09:19:23.283934Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:19:23.379228Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:18:03Z/40dd11f13a-a42e-4986-bcaa-5e8bc27a8a0b 2025-12-09T09:19:23.379415Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.2858s 2025-12-09T09:19:23.380269Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:19:23.490770Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:18:03Z/40a2c0659c-5d34-4255-b734-5d5e4cbad79c 2025-12-09T09:19:23.490863Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.3972s 2025-12-09T09:19:23.491732Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF === FAIL: tests/integration/telemetry/api TestStatsTCPFilter (89.51s) 2025-12-09T09:17:56.948375Z info tf === BEGIN: Test: 'telemetry_api[TestStatsTCPFilter]' === 2025-12-09T09:19:24.789689Z info tf === DONE (failed): Test: 'telemetry_api[TestStatsTCPFilter] (1m27.841303356s)' === 2025-12-09T09:19:24.789871Z error tf === Dumping Namespace external State for TestStatsTCPFilter... 2025-12-09T09:19:24.789886Z error tf === Dumping Namespace echo State for TestStatsTCPFilter... 2025-12-09T09:19:24.789873Z error tf === Dumping Namespace registry-redirector State for TestStatsTCPFilter... 2025-12-09T09:19:24.789901Z error tf === Dumping Istio Deployment State for TestStatsTCPFilter... 2025-12-09T09:19:25.074460Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:19:24Z/418fee20c1-ec92-4f87-9049-372b3346dbd0 2025-12-09T09:19:25.074775Z info tf istioctl ([x internal-debug --all configz]): completed after 0.2846s 2025-12-09T09:19:25.075551Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:19:25.212468Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:19:24Z/41850e18f3-2907-4181-bd14-fbcc9ce0cd32 2025-12-09T09:19:25.212592Z info tf istioctl ([x internal-debug --all mcsz]): completed after 0.4224s 2025-12-09T09:19:25.213487Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF 2025-12-09T09:19:25.334246Z info adsc Received type=istio.io/debug count=1 nonce=2025-12-09T09:19:24Z/4103f694f1-4e8e-43fe-bbf6-b5f4af7bd0de 2025-12-09T09:19:25.334405Z info tf istioctl ([x internal-debug --all clusterz]): completed after 0.5442s 2025-12-09T09:19:25.335133Z info adsc connection closed with err: rpc error: code = Unavailable desc = error reading from server: EOF DONE 2 runs, 37 tests, 4 failures in 356.145s exec: go version