[SAT-27132] [QE] Export of large amount of packages will result in errors

Type: Sub-task
Resolution: Done
Priority: Undefined
Fix Version/s: None
Affects Version/s: None
Component/s: Pulp
Labels:
- qe

Story Points:
3
Blocked:
False
Blocked Reason:

Hide

None

Show
None
Ready:
False
GitHub Issue:
https://github.com/SatelliteQE/robottelo/pull/15922
PM Score:
0
Satellite Team:

Phoenix - Content
BZ Keywords:
- Unset
Intelligence Requested:
Market:

Sprint:
Sprint 137, Sprint 138, Sprint 139, Sprint 140, Sprint 141

SFDC Cases Links:
SFDC Cases Open:
SFDC Cases Counter:

Description of problem:

How reproducible:

Is this issue a regression from an earlier version:

Steps to Reproduce:

1.

2.

3.

Actual behavior:
[Describe the issue in detail, including what is happening and where]

Expected behavior:
[Describe what should be happening instead]

Business Impact / Additional info:

QE Tracker for https://issues.redhat.com/browse/SAT-25194
Bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=2280849

Vladimír Sedmík added a comment - 2024/08/12 7:33 PM

Verified in Stream snap 70.0:

1. Enabled and synced these repos with immediate dwl policy:
[root@sat ~]# hammer repository-set list --organization-id 1 --enabled 1
-----|----|-----------------------------------------------------------------------
ID | TYPE | NAME
-----|----|-----------------------------------------------------------------------
2456 | yum | Red Hat Enterprise Linux 7 Server (RPMs)
7416 | yum | Red Hat Enterprise Linux 8 for x86_64 - BaseOS (RPMs)
11055 | yum | Red Hat Enterprise Linux 9 for x86_64 - AppStream (RPMs)
11049 | yum | Red Hat Enterprise Linux 9 for x86_64 - BaseOS (RPMs)
2808 | yum | Red Hat Software Collections RPMs for Red Hat Enterprise Linux 7 Server
-----|----|-----------------------------------------------------------------------
[root@sat ~]# du -sh /var/lib/pulp/media/artifact/
196G /var/lib/pulp/media/artifact/

2. Created and published CV with all the repos, checked it had 92087 RPMs inside.

3. Exported the CV
[root@sat ~]# hammer content-export complete version --chunk-size-gb=40 --content-view="CV-1" --organization-id=1 --version=1.0
[..................................................................................................................................] [100%]
Generated /var/lib/pulp/exports/Default_Organization/CV-1/1.0/2024-08-12T13-54-13-04-00/metadata.json
[root@sat ~]# ll -h /var/lib/pulp/exports/Default_Organization/CV-1/1.0/2024-08-12T13-54-13-04-00/
total 199G
~~rw-r~~r-. 1 pulp pulp 40G Aug 12 13:58 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0000
~~rw-r~~r-. 1 pulp pulp 40G Aug 12 14:01 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0001
~~rw-r~~r-. 1 pulp pulp 40G Aug 12 14:05 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0002
~~rw-r~~r-. 1 pulp pulp 40G Aug 12 14:08 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0003
~~rw-r~~r-. 1 pulp pulp 39G Aug 12 14:20 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0004
~~rw-r~~r-. 1 pulp pulp 484 Aug 12 14:27 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754-toc.json
~~rw-r~~r-. 1 root root 4.4K Aug 12 14:28 metadata.json

The export task succeeded and created chunked archives with the same total size as original artifacts.

Vladimír Sedmík added a comment - 2024/08/12 7:33 PM Verified in Stream snap 70.0: 1. Enabled and synced these repos with immediate dwl policy: [root@sat ~] # hammer repository-set list --organization-id 1 --enabled 1 ----- | ---- | ----------------------------------------------------------------------- ID | TYPE | NAME ----- | ---- | ----------------------------------------------------------------------- 2456 | yum | Red Hat Enterprise Linux 7 Server (RPMs) 7416 | yum | Red Hat Enterprise Linux 8 for x86_64 - BaseOS (RPMs) 11055 | yum | Red Hat Enterprise Linux 9 for x86_64 - AppStream (RPMs) 11049 | yum | Red Hat Enterprise Linux 9 for x86_64 - BaseOS (RPMs) 2808 | yum | Red Hat Software Collections RPMs for Red Hat Enterprise Linux 7 Server ----- | ---- | ----------------------------------------------------------------------- [root@sat ~] # du -sh /var/lib/pulp/media/artifact/ 196G /var/lib/pulp/media/artifact/ 2. Created and published CV with all the repos, checked it had 92087 RPMs inside. 3. Exported the CV [root@sat ~] # hammer content-export complete version --chunk-size-gb=40 --content-view="CV-1" --organization-id=1 --version=1.0 [..................................................................................................................................] [100%] Generated /var/lib/pulp/exports/Default_Organization/CV-1/1.0/2024-08-12T13-54-13-04-00/metadata.json [root@sat ~] # ll -h /var/lib/pulp/exports/Default_Organization/CV-1/1.0/2024-08-12T13-54-13-04-00/ total 199G rw-r r -. 1 pulp pulp 40G Aug 12 13:58 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0000 rw-r r -. 1 pulp pulp 40G Aug 12 14:01 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0001 rw-r r -. 1 pulp pulp 40G Aug 12 14:05 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0002 rw-r r -. 1 pulp pulp 40G Aug 12 14:08 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0003 rw-r r -. 1 pulp pulp 39G Aug 12 14:20 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754.tar.0004 rw-r r -. 1 pulp pulp 484 Aug 12 14:27 export-019147b9-f28f-783a-87fc-f629e31e813e-20240812_1754-toc.json rw-r r -. 1 root root 4.4K Aug 12 14:28 metadata.json The export task succeeded and created chunked archives with the same total size as original artifacts.

Details

Description

Attachments

Easy Agile Planning Poker

Activity

Collapse comment: Vladimír Sedmík added a comment - 2024/08/12 7:33 PM

Expand comment: Vladimír Sedmík added a comment - 2024/08/12 7:33 PM

People

Dates