Uploaded image for project: 'OpenShift GitOps'
  1. OpenShift GitOps
  2. GITOPS-3192

OpenShift GitOps Performance Issue (v1.8.4)

    XMLWordPrintable

Details

    • 8
    • False
    • None
    • False
    • Hide
      Before this update, some users were observing that Argo CD was becoming unresponsive with an increase in namespaces and applications . This update fixes the issue by removing a deadlock happening when two functions were competing for mutexes. Now, users shouldn’t experience crashes or unresponsiveness when they have a large number of resources.
      Show
      Before this update, some users were observing that Argo CD was becoming unresponsive with an increase in namespaces and applications . This update fixes the issue by removing a deadlock happening when two functions were competing for mutexes. Now, users shouldn’t experience crashes or unresponsiveness when they have a large number of resources.

    Description

      Description of problem:

      We are facing a performance issue with GitOps and the workload is not that much 53 namespaces and over 200+ applications on the cluster. Sometimes argocd is getting unresponsive due to this. 

      Tried increasing operation 10 --> 15, and status 20 --> 25 but it didn't work.

      Prerequisites (if any, like setup, operators/versions):

      Steps to Reproduce

      1. NA

      Actual results:

      Expected results:

      Reproducibility (Always/Intermittent/Only Once): Build Details:

      Additional info (Such as Logs, Screenshots, etc):

      Acceptance criteria:
      -  Create a reproducer that is able to replicate the described issue across a period of 24-48 hrs
      -  Use same reproducer containing a build of Argo CD that contains the fix for the deadlock issue (Argo CD v2.6.8/2.7.3) to verify that issue is not observed over the same time period ** 

      Attachments

        1. 0110-inspect.local.9083983123476510452.tar.gz
          3.99 MB
        2. cpu_memory.png
          cpu_memory.png
          131 kB
        3. go-routines.png
          go-routines.png
          33 kB
        4. inspect.tar.gz
          8.85 MB
        5. project-gitops-inspect.tar.gz
          13.62 MB
        6. reconciliation.png
          reconciliation.png
          53 kB

        Issue Links

          Activity

            People

              abenaiss Akram Ben Aissi
              rescott1 Regina Scott
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: