Uploaded image for project: 'Red Hat Advanced Cluster Management'
  1. Red Hat Advanced Cluster Management
  2. ACM-13127

ACM must-gather takes too much time in large scale environment

XMLWordPrintable

    • False
    • None
    • False
    • None

      Description of problem:

      Ran an acm must-gather in the large scale environment with 3672 managed clusters, (3639 ztp-done=) and the collection took 101 minutes.  Is it possible to reduce the time required to run this?

      # time oc adm must-gather --image d16-h01-000-r650.rdu2.scalelab.redhat.com:5000/acm-d/acm-must-gather-rhel9:v2.11.0-37 --dest-dir="hub-acm-must-gather-2"
      ...
      [must-gather      ] OUT 2024-08-07T13:41:00.983370263Z clusterrolebinding.rbac.authorization.k8s.io/must-gather-zhwlc deleted                                                                
      Reprinting Cluster State:
      When opening a support case, bugzilla, or issue please include the following summary data along with any other requested information:                                                        
      ClusterID: abebee12-e0d1-4a11-98d5-728686494efa
      ClientVersion: 4.16.3
      ClusterVersion: Stable at "4.16.3"
      ClusterOperators:
              clusteroperator/machine-config is degraded because Failed to resync 4.16.3 because: error during syncRequiredMachineConfigPools: [context deadline exceeded, failed to update clusteroperator: [client rate limiter Wait returned an error: context deadline exceeded, error MachineConfigPool master is not ready, retrying. Status: (pool degraded: true total: 3, ready 0, updated: 0, unavailable: 3)]]
      
      real    101m25.969s
      user    1m15.719s
      sys     0m52.855s
      

       

       

      Version-Release number of selected component (if applicable):

      Hub 4.16.3

      Deployed OCP - 4.14.31

      ACM - 2.11.0-DOWNSTREAM-2024-07-10-21-49-48

      How reproducible:

      Steps to Reproduce:

      1.  
      2.  
      3. ...

      Actual results:

      Expected results:

      Additional info:

              dhaiduce Dale Haiducek
              akrzos@redhat.com Alex Krzos
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

                Created:
                Updated: