Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-8503

Create monitors and alerts for slow pulls

XMLWordPrintable

    • Icon: Task Task
    • Resolution: Duplicate
    • Icon: Normal Normal
    • None
    • None
    • None
    • 5
    • False
    • Hide

      None

      Show
      None
    • False

      We recently saw slow pulls in Singapore on CloudFlare. Images were sporadically being pulled at 200Kbps, preventing OCP clusters from coming up. Turns out there was network instability in APAC on CloudFlare. We moved all the APAC traffic to CloudFront and the issue went away. This task is to create a set of monitors that can be used to track pull times and if pulls appear working but slow, to raise an alarm. Please coordinate with AppSRE on a runbook to troubleshoot this issue. The solution will be to change CDN from Akamai to CloudFront temporarily.

              hgovinda Harish Govindarajulu
              doconnor@redhat.com Dave O'Connor
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated:
                Resolved: