Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-4354

[release-5.8] Loki Alerts are not visible to Cluster-admin on console

XMLWordPrintable

    • False
    • None
    • False
    • NEW
    • VERIFIED
    • Release Note Not Required

      Description: Loki Alerts are not visible to Cluster admin on OCP console. Alerts are firing and can be queried through AlertManager route. 'MyApplicationLogVolumeIsHigh' is the defined Loki log alert for ap tenant.

      Steps to reproduce:
      1) Forward logs to default Loki
      2) Create Alerting rule for app tenant
      3) Validate data in rules CM
      4) Check Ruler logs for errors
      5) Check OCP console for pending/firing alerts
      6) Query for Alerts with AM route

      Logs:

      curl -k -H "Authorization: Bearer $(oc whoami -t)" https://alertmanager-main-openshift-monitoring.apps.kbharti-0717a.qe.devcluster.openshift.com/api/v1/alerts | jq -r '.data[].labels.alertname'
        % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                       Dload  Upload   Total   Spent    Left  Speed
      100  5762    0  5762    0     0  25949      0 -::- -::- -::- 25954
      CannotRetrieveUpdates
      Watchdog
      AlertmanagerReceiversNotConfigured
      MyApplicationLogVolumeIsHigh
      InsightsRecommendationActive
      $ oc get deployment logging-view-plugin -n openshift-logging -o json | jq -r '.spec.template.spec.containers[].args'
      [
        "-port",
        "9443",
        "-features",
        "alerts,dev-console",
        "-cert",
        "/var/serving-cert/tls.crt",
        "-key",
        "/var/serving-cert/tls.key",
        "-plugin-config-path",
        "/etc/plugin/config/config.yaml"
      ]

      Console screen attached

      CSV:

      $ oc get csv -n openshift-logging
      NAME                     DISPLAY                     VERSION   REPLACES   PHASE
      cluster-logging.v5.8.0   Red Hat OpenShift Logging   5.8.0                Succeeded
      loki-operator.v5.8.0     Loki Operator               5.8.0                Succeeded

      OCP Version: 4.14

      How reproducible: Always

      Actual Result: Alerts are not visible for cluster-admin but can be queried through AM route

      Expected Result: Alerts should be visible for cluster-admin

              gbernal@redhat.com Gabriel Bernal
              rhn-support-kbharti Kabir Bharti
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: