We see that not all the metrics are reported by virt-controller.

We suspect the issue is related to an issue with the kubevirt_vm_disk_allocated_size_bytes metric.

4.18

1.
2.
3.

Not all metrics are reported

All metrics should be reported

An error has occurred while serving metrics:

117936 error(s) occurred:
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"rootdisk"}  label:{name:"name"  value:"rhel9-southern-damselfly"}  label:{name:"namespace"  value:"yifat"}  label:{name:"persistentvolumeclaim"  value:"rhel9-southern-damselfly"}  label:{name:"volume_mode"  value:"Filesystem"}  gauge:{value:3.4087042032e+10}} was collected before with the same name and label values
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"rootdisk"}  label:{name:"name"  value:"centos-stream8-plum-chipmunk-90"}  label:{name:"namespace"  value:"fabiand"}  label:{name:"persistentvolumeclaim"  value:"centos-stream8-plum-chipmunk-90-volume"}  label:{name:"volume_mode"  value:"Filesystem"}  gauge:{value:3.274104832e+09}} was collected before with the same name and label values
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"f4c97f14-349e-4822-8862-6214760c83f8"}  label:{name:"name"  value:"ilpinto-ecosys-master-2"}  label:{name:"namespace"  value:"rhv-ilpinto"}  label:{name:"persistentvolumeclaim"  value:"f4c97f14-349e-4822-8862-6214760c83f8"}  label:{name:"volume_mode"  value:"Filesystem"}  gauge:{value:1.41733920768e+11}} was collected before with the same name and label values
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"d2a80bf9-717e-471d-a3b5-2547b5e5fd02"}  label:{name:"name"  value:"sgratch-01"}  label:{name:"namespace"  value:"rhv-sgratch"}  label:{name:"persistentvolumeclaim"  value:"d2a80bf9-717e-471d-a3b5-2547b5e5fd02"}  label:{name:"volume_mode"  value:"Filesystem"}  gauge:{value:5.905580032e+10}} was collected before with the same name and label values
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"rootdisk"}  label:{name:"name"  value:"rhel9-t5j0v2h1qjjr341y"}  label:{name:"namespace"  value:"rsdeor"}  label:{name:"persistentvolumeclaim"  value:"rhel9-t5j0v2h1qjjr341y"}  label:{name:"volume_mode"  value:"Block"}  gauge:{value:3.221225472e+10}} was collected before with the same name and label values
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"rootdisk"}  label:{name:"name"  value:"centos-stream8-yellow-crocodile-26"}  label:{name:"namespace"  value:"ssardarns"}  label:{name:"persistentvolumeclaim"  value:"centos-stream8-yellow-crocodile-26"}  label:{name:"volume_mode"  value:"Filesystem"}  gauge:{value:3.4087042032e+10}} was collected before with the same name and label values
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"5dbf0b78-071f-454e-8215-224d7bc35d3c"}  label:{name:"name"  value:"deimos"}  label:{name:"namespace"  value:"rhv-smelamud"}  label:{name:"persistentvolumeclaim"  value:"5dbf0b78-071f-454e-8215-224d7bc35d3c"}  label:{name:"volume_mode"  value:"Filesystem"}  gauge:{value:7.5591424409e+10}} was collected before with the same name and label values
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"rootdisk"}  label:{name:"name"  value:"rhel-9-fuchsia-bear-29"}  label:{name:"namespace"  value:"rsdeor"}  label:{name:"persistentvolumeclaim"  value:"rhel-9-fuchsia-bear-29-volume"}  label:{name:"volume_mode"  value:"Filesystem"}  gauge:{value:1.594441728e+09}} was collected before with the same name and label values
* collected metric "kubevirt_vm_disk_allocated_size_bytes" { label:{name:"device"  value:"rootdisk"}  label:{name:"name"  value:"fedora-balanced-tuna"}  label:{name:"namespace"  value:"dshah"}  label:{name:"persistentvolumeclaim"  value:"fedora-balanced-tuna"}  label:{name:"volume_mode"  value:"Filesystem"}  gauge:{value:3.4087042032e+10}} was collected before with the same name and label values