Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-2156

Dashboard for OpenShift Logging in WebConsole shows incorrect number of shards

    XMLWordPrintable

Details

    • False
    • False
    • NEW
    • VERIFIED
    • Hide
      Before this update, the OpenShift Logging dashboard use to show number of shards 'x' times bigger than actual value when elasticsearch has 'x' nodes. This was because it was printing all primary shards for each ES pod and processing sum on it while the output is always for the whole ES cluster. With this update, the calculation has been corrected.
      Show
      Before this update, the OpenShift Logging dashboard use to show number of shards 'x' times bigger than actual value when elasticsearch has 'x' nodes. This was because it was printing all primary shards for each ES pod and processing sum on it while the output is always for the whole ES cluster. With this update, the calculation has been corrected.
    • Logging (LogExp) - Sprint 213

    Description

      There are two dashboards for Logging.
      1. Logging / Elasticsearch – which presents the number of Elasticsearch cluster Primary Shards and All Shards.
      max(es_cluster_shards_number{cluster="elasticsearch",type="active"})

      2. OpenShift Logging – which presents a number of shards. But this value is 3x bigger than reality. It is counted by: 
      sum(sum by(instance)(es_cluster_shards_number{type='active_primary'}))
      and the result in my case is 33 shards while the reality is: 11 shards (+/-). So when we check the number of shards in the OpenShift Logging with:

      $ oc exec $ES_POD -- shards
      or
      $ ec exec $ES_PODS -- es_util --query=_cat/shards

       We can see that the number of shards in the ES cluster is less. Looks like the metric is printing all primary shards for each ES pod and processing sum on it while the output is always for the whole ES cluster.

      Attachments

        Activity

          People

            sasagarw@redhat.com Sashank Agarwal (Inactive)
            sasagarw@redhat.com Sashank Agarwal (Inactive)
            Anping Li Anping Li
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: