Uploaded image for project: 'OpenShift Monitoring'
  1. OpenShift Monitoring
  2. MON-3862

Smooth transition to new duplicate handling in Prometheus

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Done
    • Icon: Undefined Undefined
    • None
    • None
    • None
    • None
    • 3
    • False
    • None
    • False
    • NEW
    • NEW
    • MON Sprint 253, MON Sprint 255

      Starting with 2.52.0 (shipped in 4.16) Prometheus will increment the metric "prometheus_target_scrapes_sample_duplicate_timestamp_total" when bumping into "duplicates" while scraping a target.

      The alert "PrometheusDuplicateTimestamps" may start fire (just after the upgrade) if there are some targets unintentionally exposing duplicates (or relying on the old behaviour). The new warning logs could be confusing as well.

      We should make sure to document this new behaviour:

      • release notes?
      • runbook for PrometheusDuplicateTimestamps (maybe this is sufficient)


      See: https://github.com/prometheus/prometheus/issues/14089

            rh-ee-amrini Ayoub Mrini
            rh-ee-amrini Ayoub Mrini
            Simon Pasquier
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: