Uploaded image for project: 'OpenShift Logging'
  1. OpenShift Logging
  2. LOG-4683

Sometimes the normal users can not create index pattern before the first app index roll over

    XMLWordPrintable

Details

    • False
    • None
    • False
    • NEW
    • VERIFIED
    • Hide
      Before this update, the creation of each log output initial index was missing the default alias caused kibana users not being able to create index patterns under the condition that the index was created through first bulk index request from the collector and not by the Elasticsearch Operator. With this update, the Elasticsearch Operator adding missing aliases resolves the issue and Kibana users can create index patterns that include the {app,infra,audit}-000001 indices.
      Show
      Before this update, the creation of each log output initial index was missing the default alias caused kibana users not being able to create index patterns under the condition that the index was created through first bulk index request from the collector and not by the Elasticsearch Operator. With this update, the Elasticsearch Operator adding missing aliases resolves the issue and Kibana users can create index patterns that include the {app,infra,audit}-000001 indices.
    • Bug Fix
    • Log Storage - Sprint 244, Log Storage - Sprint 245

    Description

      Description of problem:

      Sometimes, the normal users can not create index pattern before the app index roll over.   After app index rolled over(app-000002 appears), user can create index pattern.

       

      How reproducible:
      Sometimes

      Steps to Reproduce:

      1.  Try to create index pattern using normal users

      Actual results:

      1. Can not find any Elasticsearch data when try to create index pattern.
      2. Elasticsearch pods raise message below.  
      [2023-10-18T13:36:50,383][INFO ][c.a.o.s.f.OpenDistroSecurityFilter] [elasticsearch-cdm-j22b5uty-1] Request IndexRequest requires new tenant index .kibana_-1595131455_testuser1_1 with aliases [.kibana_-1595131455_testuser1]
      [2023-10-18T13:36:50,389][INFO ][o.e.c.m.MetaDataCreateIndexService] [elasticsearch-cdm-j22b5uty-1] [.kibana_-1595131455_testuser1_1] creating index, cause [auto(multi-tenant)], templates [common.settings.kibana.template.json, kibana_index_template:.kibana_*], shards [1]/[0], mappings [doc]
      [2023-10-18T13:36:50,428][INFO ][o.e.c.r.a.AllocationService] [elasticsearch-cdm-j22b5uty-1] Cluster health status changed from [YELLOW] to [GREEN] (reason: [shards started [[.kibana_-1595131455_testuser1_1][0]] ...]).
      java.lang.UnsupportedOperationException
          at java.base/java.util.Collections$UnmodifiableMap.put(Collections.java:1457)
          at com.amazon.opendistroforelasticsearch.security.dlic.rest.api.PermissionsInfoAction$1.accept(PermissionsInfoAction.java:103)
          at com.amazon.opendistroforelasticsearch.security.dlic.rest.api.PermissionsInfoAction$1.accept(PermissionsInfoAction.java:87)
          at org.elasticsearch.rest.BaseRestHandler.handleRequest(BaseRestHandler.java:115)
          at com.amazon.opendistroforelasticsearch.security.filter.OpenDistroSecurityRestFilter$1.handleRequest(OpenDistroSecurityRestFilter.java:94)
          at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:240)
          at org.elasticsearch.rest.RestController.tryAllHandlers(RestController.java:336)
          at org.elasticsearch.rest.RestController.dispatchRequest(RestController.java:174)
          at com.amazon.opendistroforelasticsearch.security.ssl.http.netty.ValidatingDispatcher.dispatchRequest(ValidatingDispatcher.java:76)
          at org.elasticsearch.http.netty4.Netty4HttpServerTransport.dispatchRequest(Netty4HttpServerTransport.java:551)
          at org.elasticsearch.http.netty4.Netty4HttpRequestHandler.channelRead0(Netty4HttpRequestHandler.java:137)
          at io.netty.channel.SimpleChannelInboundHandler.channelRead(SimpleChannelInboundHandler.java:99)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at org.elasticsearch.http.netty4.pipelining.HttpPipeliningHandler.channelRead(HttpPipeliningHandler.java:68)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.codec.MessageToMessageDecoder.channelRead(MessageToMessageDecoder.java:103)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:327)
          at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:299)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.handler.ssl.SslHandler.unwrap(SslHandler.java:1372)
          at io.netty.handler.ssl.SslHandler.decodeJdkCompatible(SslHandler.java:1235)
          at io.netty.handler.ssl.SslHandler.decode(SslHandler.java:1284)
          at io.netty.handler.codec.ByteToMessageDecoder.decodeRemovalReentryProtection(ByteToMessageDecoder.java:510)
          at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:449)
          at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:279)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:357)
          at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:379)
          at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:365)
          at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919)
          at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166)
          at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:722)
          at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:623)
          at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:586)
          at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:496)
          at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:986)
          at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
          at java.base/java.lang.Thread.run(Thread.java:829)
      [2023-10-18T13:37:52,261][INFO ][o.e.c.m.MetaDataMappingService] [elasticsearch-cdm-j22b5uty-1] [app-000001/2KdgskKuQ_ybDTzskxbrHQ] update_mapping [_doc]

      Additional info:

      Once  the app index roll over( 8h by default), the user can create index pattern.
      )

      Attachments

        Activity

          People

            ptsiraki@redhat.com Periklis Tsirakidis
            anli@redhat.com Anping Li
            Anping Li Anping Li
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: