Uploaded image for project: 'OpenShift Monitoring'
  1. OpenShift Monitoring
  2. MON-3862

Smooth transition to new duplicate handling in Prometheus

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • None
    • None
    • 3
    • False
    • None
    • False
    • NEW
    • NEW
    • MON Sprint 253, MON Sprint 255

      Starting with 2.52.0 (shipped in 4.16) Prometheus will increment the metric "prometheus_target_scrapes_sample_duplicate_timestamp_total" when bumping into "duplicates" while scraping a target.

      The alert "PrometheusDuplicateTimestamps" may start fire (just after the upgrade) if there are some targets unintentionally exposing duplicates (or relying on the old behaviour). The new warning logs could be confusing as well.

      We should make sure to document this new behaviour:

      • release notes?
      • runbook for PrometheusDuplicateTimestamps (maybe this is sufficient)


      See: https://github.com/prometheus/prometheus/issues/14089

              rh-ee-amrini Ayoub Mrini
              rh-ee-amrini Ayoub Mrini
              Simon Pasquier
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: