Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-4354

[release-5.8] Loki Alerts are not visible to Cluster-admin on console

XMLWordPrintable

    • False
    • None
    • False
    • NEW
    • VERIFIED
    • Release Note Not Required

      Description: Loki Alerts are not visible to Cluster admin on OCP console. Alerts are firing and can be queried through AlertManager route. 'MyApplicationLogVolumeIsHigh' is the defined Loki log alert for ap tenant.

      Steps to reproduce:
      1) Forward logs to default Loki
      2) Create Alerting rule for app tenant
      3) Validate data in rules CM
      4) Check Ruler logs for errors
      5) Check OCP console for pending/firing alerts
      6) Query for Alerts with AM route

      Logs:

      curl -k -H "Authorization: Bearer $(oc whoami -t)" https://alertmanager-main-openshift-monitoring.apps.kbharti-0717a.qe.devcluster.openshift.com/api/v1/alerts | jq -r '.data[].labels.alertname'
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                       Dload  Upload   Total   Spent    Left  Speed
      100  5762    0  5762    0     0  25949      0 -::- -::- -::- 25954
      CannotRetrieveUpdates
      Watchdog
      AlertmanagerReceiversNotConfigured
      MyApplicationLogVolumeIsHigh
      InsightsRecommendationActive
      $ oc get deployment logging-view-plugin -n openshift-logging -o json | jq -r '.spec.template.spec.containers[].args'
      [
        "-port",
        "9443",
        "-features",
        "alerts,dev-console",
        "-cert",
        "/var/serving-cert/tls.crt",
        "-key",
        "/var/serving-cert/tls.key",
        "-plugin-config-path",
        "/etc/plugin/config/config.yaml"
      ]

      Console screen attached

      CSV:

      $ oc get csv -n openshift-logging
      NAME                     DISPLAY                     VERSION   REPLACES   PHASE
      cluster-logging.v5.8.0   Red Hat OpenShift Logging   5.8.0                Succeeded
      loki-operator.v5.8.0     Loki Operator               5.8.0                Succeeded

      OCP Version: 4.14

      How reproducible: Always

      Actual Result: Alerts are not visible for cluster-admin but can be queried through AM route

      Expected Result: Alerts should be visible for cluster-admin

            gbernal@redhat.com Gabriel Bernal
            rhn-support-kbharti Kabir Bharti
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: