Uploaded image for project: 'Satellite'
  1. Satellite
  2. SAT-42697

Sync memory consumption too high in pathological cases

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • 6.17.z, 6.18.z, 6.19.0
    • None
    • None
    • None
    • False
    • pulp-rpm-3.29.10-1, pulp-rpm-3.32.8-1, pulp-rpm-3.27.11-1
    • pulp-project
    • None
    • None
    • None
    • None

      Several repositories, including but not limited to

      https://yum.oracle.com/repo/OracleLinux/OL9/developer/x86_64/
      https://packages.cloud.google.com/yum/repos/cloud-sdk-el9-x86_64/
      https://artifacts.elastic.co/packages/8.x/yum/
      https://packages.grafana.com/oss/rpm/
       

      Are known to cause very high memory consumption of pulp_rpm when synced - often more than 6gb or as high as 10gb for the OL9 developer repo.  The cause of this is having many different versions of packages with very long and extensive "filelists" as the strings representing those files are held for a long time prior to the package being saved.  We need to reduce the peak memory usage.

       

      https://github.com/pulp/pulp_rpm/issues/4086

              Unassigned Unassigned
              rhn-engineering-dalley Daniel Alley
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: