Uploaded image for project: 'OpenShift Monitoring'
  1. OpenShift Monitoring
  2. MON-2598

Missing subscription_labels metric - gaps in data written to Telemeter from AMS Prometheus over remote-write-proxy

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • None
    • False
    • None
    • False
    • NEW
    • NEW

      We got a report on forum-telemetry that DataHub is seeing gaps in some of their data (see messages and dashboard screenshots): https://coreos.slack.com/archives/CEG5ZJQ1G/p1654762610358659 

      After a quick initial check on our side, I have confirmed that we are seeing gaps in rule data that depend on `subscription_labels` metrics, which should be written over to Telemeter via the remote-write-proxy from AMS Prometheus, see the gap on subsrciption_labels: 

        1. image-2022-06-09-11-14-09-468.png
          image-2022-06-09-11-14-09-468.png
          75 kB
        2. image-2022-06-09-11-15-52-281.png
          image-2022-06-09-11-15-52-281.png
          116 kB
        3. image-2022-06-09-11-46-46-421.png
          image-2022-06-09-11-46-46-421.png
          232 kB
        4. image-2022-06-09-11-48-18-451.png
          image-2022-06-09-11-48-18-451.png
          60 kB
        5. image-2022-06-09-11-57-38-279.png
          image-2022-06-09-11-57-38-279.png
          77 kB
        6. image-2022-06-09-15-57-04-104.png
          image-2022-06-09-15-57-04-104.png
          64 kB
        7. image-2022-06-09-15-57-50-698.png
          image-2022-06-09-15-57-50-698.png
          57 kB

              Unassigned Unassigned
              mgera@redhat.com Matej Gera (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: