Uploaded image for project: 'Hybrid Cloud Console'
  1. Hybrid Cloud Console
  2. RHCLOUD-32849

3scale Latency RCA Action Items

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • Unset
    • No
    • Access & Management Sprint 89, Access & Management Sprint 90, Access & Management Sprint 91, Access & Management Sprint 92, Access & Management Sprint 93, Access & Management Sprint 94, A&M Tech Debt Q10, Access & Management Sprint 95, Access & Management Sprint 95, Access & Management Sprint 96, Access & Management Sprint 97, Access & Management Sprint 98, Access & Management Sprint 99, Access & Management Sprint 100

      The 3scale gateway for ConsoleDot experienced higher than normal latency on all API requests by approximately 2 seconds in some but not all cases, for just under 2 hours (from ~12am UTC to ~1:40am UTC), triggering a prod latency alert.

       

      This story will contain the AI sub tasks that result from the RCA. 

          1.
          		 [SPIKE]Ensure calls to log gateway requests are non-blocking Sub-task Backlog Normal Unassigned
          2.
          		 [Spike] Look at increasing resources/replicas for cloudwatch-aggregator Sub-task Closed Normal Petra Cihalova
          3.
          		 Add alerts for cloudwatch-aggregator Sub-task Backlog Normal Unassigned
          4.
          		 [Spike] Investigate changes to the upstream apicast base image Sub-task Closed Normal Daniel Agbay
          5.
          		 [Spike] Investigate and fix high latency of gateway api calls in stage Sub-task Closed Normal Daniel Agbay

              Unassigned Unassigned
              abaiken Ashley Morgan
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: