Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-4683

Sometimes the normal users can not create index pattern before the first app index roll over

XMLWordPrintable

    • False
    • None
    • False
    • NEW
    • VERIFIED
    • Hide
      Before this update, the creation of each log output initial index was missing the default alias caused kibana users not being able to create index patterns under the condition that the index was created through first bulk index request from the collector and not by the Elasticsearch Operator. With this update, the Elasticsearch Operator adding missing aliases resolves the issue and Kibana users can create index patterns that include the {app,infra,audit}-000001 indices.
      Show
      Before this update, the creation of each log output initial index was missing the default alias caused kibana users not being able to create index patterns under the condition that the index was created through first bulk index request from the collector and not by the Elasticsearch Operator. With this update, the Elasticsearch Operator adding missing aliases resolves the issue and Kibana users can create index patterns that include the {app,infra,audit}-000001 indices.
    • Bug Fix
    • Log Storage - Sprint 244, Log Storage - Sprint 245
    • Low

      Description of problem:

      Sometimes, the normal users can not create index pattern before the app index roll over.   After app index rolled over(app-000002 appears), user can create index pattern.

       

      How reproducible:
      Sometimes

      Steps to Reproduce:

      1.  Try to create index pattern using normal users

      Actual results:

      1. Can not find any Elasticsearch data when try to create index pattern.
      2. Elasticsearch pods raise message below.  
      [2023-10-18T13:36:50,383][INFO ][c.a.o.s.f.OpenDistroSecurityFilter] [elasticsearch-cdm-j22b5uty-1] Request IndexRequest requires new tenant index .kibana_-1595131455_testuser1_1 with aliases [.kibana_-1595131455_testuser1]
      [2023-10-18T13:36:50,389][INFO ][o.e.c.m.MetaDataCreateIndexService] [elasticsearch-cdm-j22b5uty-1] [.kibana_-1595131455_testuser1_1] creating index, cause [auto(multi-tenant)], templates [common.settings.kibana.template.json, kibana_index_template:.kibana_*], shards [1]/[0], mappings [doc]
      [2023-10-18T13:36:50,428][INFO ][o.e.c.r.a.AllocationService] [elasticsearch-cdm-j22b5uty-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.kibana_-1595131455_testuser1_1][0]] ...]).
      java.lang.UnsupportedOperationException
          at java.base/java.util.Collections$UnmodifiableMap.put(Collections.java:1457)
          at com.amazon.opendistroforelasticsearch.security.dlic.rest.api.PermissionsInfoAction$1.accept(PermissionsInfoAction.java:103)
          at com.amazon.opendistroforelasticsearch.security.dlic.rest.api.PermissionsInfoAction$1.accept(PermissionsInfoAction.java:87)
          at org.elasticsearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:115)
          at com.amazon.opendistroforelasticsearch.security.filter.OpenDistroSecurityRestFilter$1.handleRequest(OpenDistroSecurityRestFilter.java:94)
          at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:240)
          at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:336)
          at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:174)
          at com.amazon.opendistroforelasticsearch.security.ssl.http.netty.ValidatingDispatcher.dispatchRequest(ValidatingDispatcher.java:76)
          at org.elasticsearch.http.netty4.Netty4HttpServerTransport.dispatchRequest(Netty4HttpServerTransport.java:551)
          at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:137)
          at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at org.elasticsearch.http.netty4.pipelining.HttpPipeliningHandler.channelRead(HttpPipeliningHandler.java:68)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:327)
          at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:299)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1372)
          at io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1235)
          at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1284)
          at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:510)
          at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:449)
          at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:279)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
          at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
          at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:722)
          at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:623)
          at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:586)
          at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:496)
          at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
          at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
          at java.base/java.lang.Thread.run(Thread.java:829)
      [2023-10-18T13:37:52,261][INFO ][o.e.c.m.MetaDataMappingService] [elasticsearch-cdm-j22b5uty-1] [app-000001/2KdgskKuQ_ybDTzskxbrHQ] update_mapping [_doc]

      Additional info:

      Once  the app index roll over( 8h by default), the user can create index pattern.
      )

        1. es-kibana.logs.tar.gz
          15 kB
          Anping Li
        2. image-2023-11-07-21-24-12-604.png
          35 kB
          Anping Li
        3. Logging_5.8_Index_pattern.png
          71 kB
          Anping Li

              ptsiraki@redhat.com Periklis Tsirakidis
              rhn-support-anli Anping Li
              Anping Li Anping Li
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: