Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-34360

The must-gather took too long after upgrading to OpenShift 4.14

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • 4.14
    • oc
    • Moderate
    • No
    • False
    • Hide

      None

      Show
      None
    • Hide
      Cause:

      must-gather collects some cpu related performance data per node that allow debugging of cpu and topology manager features.

      Issue:

      This collection was sequential and even though the process for each node was short it accumulated quickly in bigger clusters.

      Fix:

      The node data is collected in parallel now.

      Effect:

      In our testing the must gather collection time shortened significantly (1/6 on our testing 120 node cluster).
      Show
      Cause: must-gather collects some cpu related performance data per node that allow debugging of cpu and topology manager features. Issue: This collection was sequential and even though the process for each node was short it accumulated quickly in bigger clusters. Fix: The node data is collected in parallel now. Effect: In our testing the must gather collection time shortened significantly (1/6 on our testing 120 node cluster).
    • Bug Fix
    • In Progress

      Description of problem:

          After upgrading to OpenShift 4.14, the must-gather took much longer than before.

      Version-Release number of selected component (if applicable):

          4.14

      How reproducible:

          Always

      Steps to Reproduce:

          1. Run oc adm must-gather
    2. Wait for it to complete
    3.

      Actual results:

          For a cluster with around 50 nodes, the must-gather took about 30 minutes.

      Expected results:

         For a cluster with around 50 nodes, the must-gather can finish in about 10 minutes.

      Additional info:

          It seems the gather_ppc collection script is related here.

https://github.com/openshift/must-gather/blob/release-4.14/collection-scripts/gather_ppc

            msivak@redhat.com Martin Sivak
            rhn-support-yhe Yiyong He
            Mallapadi Niranjan Mallapadi Niranjan
            Votes:
            0 Vote for this issue
            Watchers:
            12 Start watching this issue

              Created:
              Updated: