-
Bug
-
Resolution: Done
-
Undefined
-
None
-
premerge
-
None
-
Moderate
-
No
-
False
-
Description of problem:
tested https://github.com/openshift/cluster-monitoring-operator/pull/2078 with cluster-bot cluster
launch 4.16.0-0.nightly-2024-04-23-032717,openshift/cluster-monitoring-operator#2078 aws,no-spot
follow https://github.com/kubernetes/autoscaler/tree/master/vertical-pod-autoscaler#install-command to install VPA
$ git clone https://github.com/kubernetes/autoscaler.git
$ cd autoscaler/vertical-pod-autoscaler/
$ ./hack/vpa-up.sh
kube-state-metrics pod recreated, could see the VPA metrics in KSM logs
$ oc -n openshift-monitoring get pod | grep kube-state-metrics kube-state-metrics-fc6bb759f-zdgf2 3/3 Running 0 6m13s $ oc -n openshift-monitoring logs -c kube-state-metrics kube-state-metrics-fc6bb759f-zdgf2 ... I0425 07:43:14.311883 1 metrics_handler.go:99] "Autosharding disabled" I0425 07:43:14.313327 1 custom_resource_metrics.go:79] "Custom resource state added metrics" familyNames=["kube_customresource_verticalpodautoscaler_spec_updatepolicy_updatemode","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_cpu","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_memory","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_cpu","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_memory","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_cpu","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_memory","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_cpu","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_memory","kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_minallowed_cpu","kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_minallowed_memory","kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_maxallowed_cpu","kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_maxallowed_memory"] I0425 07:43:14.313547 1 builder.go:282] "Active resources" activeStoreNames="certificatesigningrequests,configmaps,cronjobs,daemonsets,deployments,endpoints,horizontalpodautoscalers,ingresses,jobs,leases,limitranges,mutatingwebhookconfigurations,namespaces,networkpolicies,nodes,persistentvolumeclaims,persistentvolumes,poddisruptionbudgets,pods,replicasets,replicationcontrollers,resourcequotas,secrets,services,statefulsets,storageclasses,validatingwebhookconfigurations,volumeattachments,autoscaling.k8s.io/v1, Resource=verticalpodautoscalers"
test VPA installation via
$ kubectl create -f examples/hamster.yaml
verticalpodautoscaler.autoscaling.k8s.io/hamster-vpa created
deployment.apps/hamster created
$ oc get vpa -A
NAMESPACE NAME MODE CPU MEM PROVIDED AGE
default hamster-vpa Auto 587m 262144k True 7m23s
could see the VPA metrics from thanos
$ token=`oc create token prometheus-k8s -n openshift-monitoring` $ oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -k -H "Authorization: Bearer $token" 'https://thanos-querier.openshift-monitoring.svc:9091/api/v1/label/__name__/values' | jq | grep kube_customresource_verticalpodautoscaler "kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_maxallowed_cpu", "kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_maxallowed_memory", "kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_minallowed_cpu", "kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_minallowed_memory", "kube_customresource_verticalpodautoscaler_spec_updatepolicy_updatemode", "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_cpu", "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_memory", "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_cpu", "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_memory", "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_cpu", "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_memory", "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_cpu", "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_memory",
but there are errors in KSM logs like "err="[status,recommendation,containerRecommendations]: got nil while resolving path" for a few metrics
$ oc -n openshift-monitoring get pod | grep kube-state-metrics kube-state-metrics-fc6bb759f-zdgf2 3/3 Running 0 24m $ oc -n openshift-monitoring logs -c kube-state-metrics kube-state-metrics-fc6bb759f-zdgf2 ... I0425 07:43:14.313327 1 custom_resource_metrics.go:79] "Custom resource state added metrics" familyNames=["kube_customresource_verticalpodautoscaler_spec_updatepolicy_updatemode","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_cpu","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_memory","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_cpu","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_memory","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_cpu","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_memory","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_cpu","kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_memory","kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_minallowed_cpu","kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_minallowed_memory","kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_maxallowed_cpu","kube_customresource_verticalpodautoscaler_spec_resourcepolicy_container_policies_maxallowed_memory"] I0425 07:43:14.313547 1 builder.go:282] "Active resources" activeStoreNames="certificatesigningrequests,configmaps,cronjobs,daemonsets,deployments,endpoints,horizontalpodautoscalers,ingresses,jobs,leases,limitranges,mutatingwebhookconfigurations,namespaces,networkpolicies,nodes,persistentvolumeclaims,persistentvolumes,poddisruptionbudgets,pods,replicasets,replicationcontrollers,resourcequotas,secrets,services,statefulsets,storageclasses,validatingwebhookconfigurations,volumeattachments,autoscaling.k8s.io/v1, Resource=verticalpodautoscalers" E0425 08:04:40.624631 1 registry_factory.go:685] "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_cpu" err="[status,recommendation,containerRecommendations]: got nil while resolving path" E0425 08:04:40.624746 1 registry_factory.go:685] "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_memory" err="[status,recommendation,containerRecommendations]: got nil while resolving path" E0425 08:04:40.624779 1 registry_factory.go:685] "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_cpu" err="[status,recommendation,containerRecommendations]: got nil while resolving path" E0425 08:04:40.624803 1 registry_factory.go:685] "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_memory" err="[status,recommendation,containerRecommendations]: got nil while resolving path" E0425 08:04:40.624828 1 registry_factory.go:685] "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_cpu" err="[status,recommendation,containerRecommendations]: got nil while resolving path" E0425 08:04:40.624852 1 registry_factory.go:685] "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_memory" err="[status,recommendation,containerRecommendations]: got nil while resolving path" E0425 08:04:40.624880 1 registry_factory.go:685] "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_cpu" err="[status,recommendation,containerRecommendations]: got nil while resolving path" E0425 08:04:40.624904 1 registry_factory.go:685] "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_memory" err="[status,recommendation,containerRecommendations]: got nil while resolving path"
check these metrics, there are not [status,recommendation,containerRecommendations] labels for these metrics
$ for i in kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_cpu kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_memory kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_cpu kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_memory kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_cpu kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_memory kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_cpu kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_memory; do echo $i; oc -n openshift-monitoring exec -c prometheus prometheus-k8s-0 -- curl -k -H "Authorization: Bearer $token" 'https://thanos-querier.openshift-monitoring.svc:9091/api/v1/query?' --data-urlencode 'query='"$i"''| jq; echo -e "\n"; done kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_cpu { "status": "success", "data": { "resultType": "vector", "result": [ { "metric": { "__name__": "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_cpu", "container": "hamster", "customresource_group": "autoscaling.k8s.io", "customresource_kind": "VerticalPodAutoscaler", "customresource_version": "v1", "endpoint": "https-main", "job": "kube-state-metrics", "namespace": "default", "prometheus": "openshift-monitoring/k8s", "resource": "cpu", "service": "kube-state-metrics", "target_api_version": "apps/v1", "target_kind": "Deployment", "target_name": "hamster", "unit": "cores", "verticalpodautoscaler": "hamster-vpa" }, "value": [ 1714033123.008, "0.467" ] } ], "analysis": {} } } kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_memory { "status": "success", "data": { "resultType": "vector", "result": [ { "metric": { "__name__": "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_memory", "container": "hamster", "customresource_group": "autoscaling.k8s.io", "customresource_kind": "VerticalPodAutoscaler", "customresource_version": "v1", "endpoint": "https-main", "job": "kube-state-metrics", "namespace": "default", "prometheus": "openshift-monitoring/k8s", "resource": "memory", "service": "kube-state-metrics", "target_api_version": "apps/v1", "target_kind": "Deployment", "target_name": "hamster", "unit": "bytes", "verticalpodautoscaler": "hamster-vpa" }, "value": [ 1714033126.181, "262144000" ] } ], "analysis": {} } } kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_cpu { "status": "success", "data": { "resultType": "vector", "result": [ { "metric": { "__name__": "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_cpu", "container": "hamster", "customresource_group": "autoscaling.k8s.io", "customresource_kind": "VerticalPodAutoscaler", "customresource_version": "v1", "endpoint": "https-main", "job": "kube-state-metrics", "namespace": "default", "prometheus": "openshift-monitoring/k8s", "resource": "cpu", "service": "kube-state-metrics", "target_api_version": "apps/v1", "target_kind": "Deployment", "target_name": "hamster", "unit": "cores", "verticalpodautoscaler": "hamster-vpa" }, "value": [ 1714033129.216, "1" ] } ], "analysis": {} } } kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_memory { "status": "success", "data": { "resultType": "vector", "result": [ { "metric": { "__name__": "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_memory", "container": "hamster", "customresource_group": "autoscaling.k8s.io", "customresource_kind": "VerticalPodAutoscaler", "customresource_version": "v1", "endpoint": "https-main", "job": "kube-state-metrics", "namespace": "default", "prometheus": "openshift-monitoring/k8s", "resource": "memory", "service": "kube-state-metrics", "target_api_version": "apps/v1", "target_kind": "Deployment", "target_name": "hamster", "unit": "bytes", "verticalpodautoscaler": "hamster-vpa" }, "value": [ 1714033132.179, "524288000" ] } ], "analysis": {} } } kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_cpu { "status": "success", "data": { "resultType": "vector", "result": [ { "metric": { "__name__": "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_cpu", "container": "hamster", "customresource_group": "autoscaling.k8s.io", "customresource_kind": "VerticalPodAutoscaler", "customresource_version": "v1", "endpoint": "https-main", "job": "kube-state-metrics", "namespace": "default", "prometheus": "openshift-monitoring/k8s", "resource": "cpu", "service": "kube-state-metrics", "target_api_version": "apps/v1", "target_kind": "Deployment", "target_name": "hamster", "unit": "cores", "verticalpodautoscaler": "hamster-vpa" }, "value": [ 1714033135.531, "0.587" ] } ], "analysis": {} } } kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_memory { "status": "success", "data": { "resultType": "vector", "result": [ { "metric": { "__name__": "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_target_memory", "container": "hamster", "customresource_group": "autoscaling.k8s.io", "customresource_kind": "VerticalPodAutoscaler", "customresource_version": "v1", "endpoint": "https-main", "job": "kube-state-metrics", "namespace": "default", "prometheus": "openshift-monitoring/k8s", "resource": "memory", "service": "kube-state-metrics", "target_api_version": "apps/v1", "target_kind": "Deployment", "target_name": "hamster", "unit": "bytes", "verticalpodautoscaler": "hamster-vpa" }, "value": [ 1714033138.731, "262144000" ] } ], "analysis": {} } } kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_cpu { "status": "success", "data": { "resultType": "vector", "result": [ { "metric": { "__name__": "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_cpu", "container": "hamster", "customresource_group": "autoscaling.k8s.io", "customresource_kind": "VerticalPodAutoscaler", "customresource_version": "v1", "endpoint": "https-main", "job": "kube-state-metrics", "namespace": "default", "prometheus": "openshift-monitoring/k8s", "resource": "cpu", "service": "kube-state-metrics", "target_api_version": "apps/v1", "target_kind": "Deployment", "target_name": "hamster", "unit": "cores", "verticalpodautoscaler": "hamster-vpa" }, "value": [ 1714033141.844, "0.587" ] } ], "analysis": {} } } kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_memory { "status": "success", "data": { "resultType": "vector", "result": [ { "metric": { "__name__": "kube_customresource_verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_memory", "container": "hamster", "customresource_group": "autoscaling.k8s.io", "customresource_kind": "VerticalPodAutoscaler", "customresource_version": "v1", "endpoint": "https-main", "job": "kube-state-metrics", "namespace": "default", "prometheus": "openshift-monitoring/k8s", "resource": "memory", "service": "kube-state-metrics", "target_api_version": "apps/v1", "target_kind": "Deployment", "target_name": "hamster", "unit": "bytes", "verticalpodautoscaler": "hamster-vpa" }, "value": [ 1714033144.873, "262144000" ] } ], "analysis": {} } }
kube-state-metrics-custom-resource-state-configmap configmap
$ oc -n openshift-monitoring get cm kube-state-metrics-custom-resource-state-configmap -oyaml apiVersion: v1 data: custom-resource-state-configmap.yaml: |- "kind": "CustomResourceStateMetrics" "spec": "resources": - "groupVersionKind": "group": "autoscaling.k8s.io" "kind": "VerticalPodAutoscaler" "version": "v1" "metrics": - "commonLabels": null "each": "stateSet": "labelName": "updatemode" "list": - "Off" - "Initial" - "Recreate" - "Auto" "path": - "spec" - "updatePolicy" - "updateMode" "type": "StateSet" "help": "Update mode of the VerticalPodAutoscaler." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_spec_updatepolicy_updatemode" - "commonLabels": "resource": "cpu" "unit": "cores" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "status" - "recommendation" - "containerRecommendations" "valueFrom": - "lowerBound" - "cpu" "type": "Gauge" "help": "Minimum cpu resources the container can use before the VerticalPodAutoscaler updater evicts it." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_cpu" - "commonLabels": "resource": "memory" "unit": "bytes" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "status" - "recommendation" - "containerRecommendations" "valueFrom": - "lowerBound" - "memory" "type": "Gauge" "help": "Minimum memory resources the container can use before the VerticalPodAutoscaler updater evicts it." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_status_recommendation_containerrecommendations_lowerbound_memory" - "commonLabels": "resource": "cpu" "unit": "cores" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "status" - "recommendation" - "containerRecommendations" "valueFrom": - "upperBound" - "cpu" "type": "Gauge" "help": "Maximum cpu resources the container can use before the VerticalPodAutoscaler updater evicts it." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_cpu" - "commonLabels": "resource": "memory" "unit": "bytes" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "status" - "recommendation" - "containerRecommendations" "valueFrom": - "upperBound" - "memory" "type": "Gauge" "help": "Maximum memory resources the container can use before the VerticalPodAutoscaler updater evicts it." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_status_recommendation_containerrecommendations_upperbound_memory" - "commonLabels": "resource": "cpu" "unit": "cores" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "status" - "recommendation" - "containerRecommendations" "valueFrom": - "target" - "cpu" "type": "Gauge" "help": "Target cpu resources the VerticalPodAutoscaler recommends for the container." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_status_recommendation_containerrecommendations_target_cpu" - "commonLabels": "resource": "memory" "unit": "bytes" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "status" - "recommendation" - "containerRecommendations" "valueFrom": - "target" - "memory" "type": "Gauge" "help": "Target memory resources the VerticalPodAutoscaler recommends for the container." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_status_recommendation_containerrecommendations_target_memory" - "commonLabels": "resource": "cpu" "unit": "cores" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "status" - "recommendation" - "containerRecommendations" "valueFrom": - "uncappedTarget" - "cpu" "type": "Gauge" "help": "Target cpu resources the VerticalPodAutoscaler recommends for the container ignoring bounds." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_cpu" - "commonLabels": "resource": "memory" "unit": "bytes" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "status" - "recommendation" - "containerRecommendations" "valueFrom": - "uncappedTarget" - "memory" "type": "Gauge" "help": "Target memory resources the VerticalPodAutoscaler recommends for the container ignoring bounds." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_status_recommendation_containerrecommendations_uncappedtarget_memory" - "commonLabels": "resource": "cpu" "unit": "cores" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "spec" - "resourcePolicy" - "containerPolicies" "valueFrom": - "minAllowed" - "cpu" "type": "Gauge" "help": "Minimum cpu resources the VerticalPodAutoscaler can set for containers matching the name." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_spec_resourcepolicy_container_policies_minallowed_cpu" - "commonLabels": "resource": "memory" "unit": "bytes" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "spec" - "resourcePolicy" - "containerPolicies" "valueFrom": - "minAllowed" - "memory" "type": "Gauge" "help": "Minimum memory resources the VerticalPodAutoscaler can set for containers matching the name." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_spec_resourcepolicy_container_policies_minallowed_memory" - "commonLabels": "resource": "cpu" "unit": "cores" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "spec" - "resourcePolicy" - "containerPolicies" "valueFrom": - "maxAllowed" - "cpu" "type": "Gauge" "help": "Minimum cpu resources the VerticalPodAutoscaler can set for containers matching the name." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_spec_resourcepolicy_container_policies_maxallowed_cpu" - "commonLabels": "resource": "memory" "unit": "bytes" "each": "gauge": "labelsFromPath": "container": - "containerName" "path": - "spec" - "resourcePolicy" - "containerPolicies" "valueFrom": - "maxAllowed" - "memory" "type": "Gauge" "help": "Minimum memory resources the VerticalPodAutoscaler can set for containers matching the name." "labelsFromPath": "namespace": - "metadata" - "namespace" "target_api_version": - "spec" - "targetRef" - "apiVersion" "target_kind": - "spec" - "targetRef" - "kind" "target_name": - "spec" - "targetRef" - "name" "verticalpodautoscaler": - "metadata" - "name" "name": "verticalpodautoscaler_spec_resourcepolicy_container_policies_maxallowed_memory" kind: ConfigMap metadata: creationTimestamp: "2024-04-25T06:38:15Z" labels: app.kubernetes.io/managed-by: cluster-monitoring-operator app.kubernetes.io/part-of: openshift-monitoring name: kube-state-metrics-custom-resource-state-configmap namespace: openshift-monitoring resourceVersion: "14388" uid: 014fd0d0-80db-49cd-90c9-b052aee6c2a4
Version-Release number of selected component (if applicable):
https://github.com/openshift/cluster-monitoring-operator/pull/2078
How reproducible:
always
Steps to Reproduce:
1. see the description
Actual results:
[status,recommendation,containerRecommendations]: got nil while resolving path" for a few metrics
Expected results:
no error
Additional info:
not affect the function
