Uploaded image for project: 'Observability Documentation'
  1. Observability Documentation
  2. OBSDOCS-1255

Per stream rate limit exceeded log example in docs is not suitable with the provided parameters to fix it

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Critical Critical
    • None
    • Logging 5.8, Logging 5.9
    • Logging
    • False
    • Hide

      None

      Show
      None
    • False
    • Important

      In the section Troubleshooting Loki rate limit errors the following "Example Loki ingester error message" is observed:

      level=warn ts=2023-08-30T14:57:34.155592243Z caller=grpc_logging.go:43 duration=1.434942ms method=/logproto.Pusher/Push err="rpc error: code = Code(429) desc = entry with timestamp 2023-08-30 14:57:32.012778399 +0000 UTC ignored, reason: 'Per stream rate limit exceeded (limit: 3MB/sec) while attempting to ingest for stream 

      This is not correct because the parameters named below (ingestionBurstSize and ingestionRate) are for rate_limited issue instead of per stream rate limit issue.

      This log example should be deleted from this part.

      To manage the latest log example --> "Example Loki ingester error message" the parameters used are perStreamRateLimit and perStreamRateLimitBurst.

       

      To summarize, the section Troubleshooting Loki rate limit errors should have two different entries:

      1) Rate_limited error with all the examples of the section except the last one (Example Loki ingester error message) and it should contain the already existing example called "Procedure" with ingestionBurstSize and ingestionRate.

      2) Per_stream_rate_limit error with the log in "Example Loki ingester error message" and after that an example using perStreamRateLimit (the value shouldn't be higher than 5MB) and perStreamRateLimitBurst(the value shouldn't be higher than 20MB).

            rhn-support-smunje Satyajeet Munje
            acandelp Adrian Candel
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: