Uploaded image for project: 'Automation Hub'
  1. Automation Hub
  2. AAH-1572

Certification pipeline held up via curate_sync_list tasks

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Critical Critical
    • None
    • cloud-2022-04-28
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False

      Description 

      The PE team is experiencing major slow downs when certifying new collections. We worked with Andrew to see what can be done but this issue is systemic it seems and is tied to the curate_sync_list task. 

      We are currently experiencing major degradation in performance, so much so we can only move content about 3 times a day. (from staging to certified repo) 

      console.redhat.com

      Priority is critical and effects production. Performance degradation is so bad, we are essentially at a stand still. 

      PE team has been monitoring the task queue via https://console.redhat.com/api/automation-hub/v3/tasks/?state=waiting

      Key Dependency Versions

      {"available_versions":\{"v3":"v3/"}

      ,"server_version":"4.6.0dev","galaxy_ng_version":"4.6.0dev","galaxy_ng_commit":"origin/master:733db34","galaxy_importer_version":"0.4.2","pulp_core_version":"3.18.3","pulp_ansible_version":"0.13.0","pulp_container_version":"2.10.3"}

      Steps to Reproduce

      Approve a collection for certification

      Actual Behavior

      Task queue takes maximum of 10+ hours to complete

      Expected Behavior

      Task queue clears in a timely manner. 

              Unassigned Unassigned
              jajackso1 Jake Jackson
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

                Created:
                Updated:
                Resolved: