Uploaded image for project: 'OpenShift Monitoring'
  1. OpenShift Monitoring
  2. MON-2911

Unable to view HCP telemetry metrics in Telemeter

    XMLWordPrintable

Details

    • Bug
    • Resolution: Done
    • Major
    • None
    • None
    • None
    • False
    • None
    • False
    • NEW
    • NEW
    • MON Sprint 229
    • 0

    Description

      We, SRE-P, are trying to ship HyperShift hosted control plane telemetry metrics to RHOBS via the Observability Operator.

      We have configured our Monitoring Stack CR  appropriately and are able to remote-write the desired metric to telemeter receiver endpoint, we aren't able to view the same in Telemeter stage.

      Prometheus pod logs:

      prometheus ts=2022-12-22T06:53:32.683Z caller=dedupe.go:112 component=remote level=debug remote_name=d28ad2 url=https://infogw.api.stage.openshift.com/metrics/v1/receive msg=QueueManager.calculateDesiredShar │
      │ ds dataInRate=2783.658339838642 dataOutRate=0.2950819679171148 dataKeptRatio=0.0001060063638130167 dataPendingRate=3.530786958361176e-06 dataPending=4.426282480561097 dataOutDuration=0.0003028842962658474 ti │
      │ mePerSample=0.0010264412237854 desiredShards=0.0005300538607194843 highestSent=1.671691997e+09 highestRecv=1.671692012e+09  

      Self-assessments done:

      • The composite token is configured correctly.
      • We are able to view HCP metrics in the RHOBS hypershift-tenant.
      • The telemetry metrics sent by the native CMO are viewable.

      There are no obvious errors, by which we can deem the metrics are being ingested successfully, we just can't see them showing up in the stage/prod telemeter instance currently.

      Attachments

        Activity

          People

            samukher@redhat.com Saswata Mukherjee
            sbasabat.openshift Supreeth Basabattini
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: