Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-65530

Insights operator regressed on firing alert: KubeJobFailed - periodic-gathering

XMLWordPrintable

    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • None
    • None
    • None
    • None
    • None
    • Approved
    • None
    • None
    • None
    • None
    • None
    • None
    • None
    • None

      (Feel free to update this bug's summary to be more specific.)
      Component Readiness has found a potential regression in the following test:

      [sig-instrumentation] Prometheus [apigroup:image.openshift.io] when installed on the cluster shouldn't report any alerts in firing state apart from Watchdog and AlertmanagerReceiversNotConfigured [Early][apigroup:config.openshift.io] [Suite:openshift/conformance/parallel]

      Significant regression detected.
      Fishers Exact probability of a regression: 99.99%.
      Test pass rate dropped from 95.36% to 82.61%.

      Sample (being evaluated) Release: 4.21
      Start Time: 2025-11-05T00:00:00Z
      End Time: 2025-11-12T16:00:00Z
      Success Rate: 82.61%
      Successes: 38
      Failures: 8
      Flakes: 0
      Base (historical) Release: 4.20
      Start Time: 2025-10-13T00:00:00Z
      End Time: 2025-11-12T16:00:00Z
      Success Rate: 95.36%
      Successes: 226
      Failures: 11
      Flakes: 0

      View the test details report for additional context.

      This has been on-going for weeks now intermittently, across many varied jobs.

          [
            {
              "metric": {
                "__name__": "ALERTS",
                "alertname": "KubeJobFailed",
                "alertstate": "firing",
                "condition": "true",
                "container": "kube-rbac-proxy-main",
                "endpoint": "https-main",
                "job": "kube-state-metrics",
                "job_name": "periodic-gathering-vswlx",
                "namespace": "openshift-insights",
                "prometheus": "openshift-monitoring/k8s",
                "service": "kube-state-metrics",
                "severity": "warning"
              },
              "value": [
                1762527154.053,
                "1"
              ]
            }
          ]
      

      Filed by: dgoodwin@redhat.com

              rh-ee-ijimeno Isaac Jimeno
              openshift-trt OpenShift Technical Release Team
              None
              None
              None
              None
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated:
                Resolved: