Uploaded image for project: 'Docs for Red Hat Developers'
  1. Docs for Red Hat Developers
  2. RHDEVDOCS-3017

Document: The shard of structuredIndex is not under control

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Not a Bug
    • Icon: Normal Normal
    • None
    • Logging 5.1
    • Logging
    • 3
    • Undefined

      Description:
      The shard of structuredIndex is not under control. it has a different number of primary shards and replicas shards compared with the default index pattern. The index is yellow when using single Elasticsearch nodes.

      health status index         uuid                   pri rep docs.count docs.deleted store.size pri.store.size
      yellow open   qa-index-name 1Vryv4tYQHuiaw4WUmcA7w   5   1        771            0      1.1mb          1.1mb
      green  open   audit-000001  FJ0Dv__uRouX7N_r3OL_rQ   1   0          0            0       230b           230b
      green  open   .kibana_1     xERI8UBHQ2STvbA5ziQwvg   1   0          0            0       230b           230b
      green  open   .security     kd3rWa7YRhaVNaveJrg3xA   1   0          5            0     28.8kb         28.8kb
      green  open   app-000001    f0g-ILYEQv65yvu0TNYAlQ   1   0          0            0       230b           230b
      green  open   infra-000001  U1muEI8mQrS-d-2PvIWb-A   1   0          0            0       230b           230b
      

      Version:
      release-5.1
      commit 4c1e571b74ea76fabf53587f1d084407a0730e00
      Author: Vimal Kumar <vimal78@gmail.com>
      Date: Mon May 17 18:54:52 2021 +0530
      LOG-1355: Support outputDefaults in Log Forwarding

      Step to Reproduce
      1. Deploy clusterlogging operaor
      2. Create application for logs
      oc new-project test
      oc new-app https://raw.githubusercontent.com/openshift-qe/v3-testfiles/master/logging/loggen/container_json_log_template.json
      3. Create ClusterLogForwarder instance

      cat <<EOF|oc create -f -
      apiVersion: logging.openshift.io/v1
      kind: ClusterLogForwarder
      metadata:
        name: instance
      spec:
        inputs:
        - application:
            namespaces:
            - project-qa-3
          name: input-qa
        outputs:
        - elasticsearch:
            structuredIndexKey: kubernetes.namespaceName
            structuredIndexName: qa-index-name
          name: default-es-a
          secret:
            name: fluentd
          type: elasticsearch
          url: https://elasticsearch.openshift-logging.svc:9200
        pipelines:
        - inputRefs:
          - input-qa
          name: pipeline-a
          outputRefs:
          - default-es-a
          structured: json
      EOF
      

      Actual result:
      The structuredIndex qa-index-name is Yellow. it has different number of primary shards and replicas shards

              Unassigned Unassigned
              rhn-support-anli Anping Li
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: