Uploaded image for project: 'Satellite'
  1. Satellite
  2. SAT-20085

Very large content import fails with subtask error

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Normal Normal
    • None
    • 6.11.5
    • Pulp
    • 0
    • False
    • Moderate
    • None
    • None
    • None
    • None

      Description of problem:
      During very large (2.1TB) content-export, the import fails after about 12 days with error "7 subtask(s) failed for task group /pulp/api/v3/task-groups/....."

      This BZ is raised in relation to support case #03609607.

      Version-Release number of selected component (if applicable):
      6.11.5.4

      How reproducible:
      Everytime

      Steps to Reproduce:
      1. place 2.1TB tar.gz file in to /var/lib/pulp/imports
      2. run command: time hammer content-import version --organization-id=1 --path/var/lib/pulp/imports/z1d-export/

      Actual results:
      import fails after about 12 days with error "7 subtask(s) failed for task group /pulp/api/v3/task-groups/....."

      Expected results:
      import does not fail

      Additional info:
      Please see the support case #03609607 which has a lot more contextual information.
      Please see https://bugzilla.redhat.com/show_bug.cgi?id=2238914.
      Test of importing a 2.1TB content export that contains:
      Repositories: 151 (both Red Hat and 3rd party repos)
      RPM Packages: >200,000
      Size of export: 2.1TB
      I did find a knowledgebase article https://access.redhat.com/solutions/6967697 which relates to a lack of memory. This was fixed in 6.11.2 and we are running 6.11.5.4. Also on this host it has 24cpu and 192GB of memory and no out of memory issues were observed when the import failed.

              jira-bugzilla-migration RH Bugzilla Integration
              jira-bugzilla-migration RH Bugzilla Integration
              RH Bugzilla Integration RH Bugzilla Integration
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

                Created:
                Updated: