Critical Description:
This is an issue found in Quay 3.15.0, after configuring proxy cache for Quay new Organization, trying to pull image from quay, when the image layer already exists in local, found Quay won't cache the image layers in Quay, pls review this issue.
Quay: quay-operator-bundle-container-v3.15.0-8
Quay.io source image:
Quay proxy cache config:
[Step1]:
pull the image from source to local, the image layer size is 9.5GB
ubuntu@ip-10-0-1-238:~$ podman pull quay.io/quay-qetest/largesize
Trying to pull quay.io/quay-qetest/largesize:latest...
Getting image source signatures
Copying blob 0094770f3035 done |
Copying blob 14d5f30b982f done |
Copying config 76e8b2c5c2 done |
Writing manifest to image destination
76e8b2c5c27d73b2b0752e5b90b81054aab23d5140b943cd9618d4f335074127
[Step2]:
Pull the same target image from quay proxy cache
ubuntu@ip-10-0-1-238:~$ podman pull quayregistry-quay-quay-enterprise-15321.apps.quaytest-15321.qe.devcluster.openshift.com/quayqe2/quay-qetest/largesize --creds quay:*** --tls-verify=false
Trying to pull quayregistry-quay-quay-enterprise-15321.apps.quaytest-15321.qe.devcluster.openshift.com/quayqe2/quay-qetest/largesize:latest...
Getting image source signatures
Copying blob 0094770f3035 skipped: already exists
Copying blob 14d5f30b982f skipped: already exists
Copying config 76e8b2c5c2 done |
Writing manifest to image destination
76e8b2c5c27d73b2b0752e5b90b81054aab23d5140b943cd9618d4f335074127
Check if Quay cache the image layers, by checking the backend storage objects, found Quay didn't cache the image layers when it already existed in local.
aws s3 ls s3://quay-datastore-6006a7ec-483c-49f6-890b-c6ae184633f2 --no-verify-ssl --recursive --summarize --human-readable
2025-06-16 12:12:31 46.2 MiB datastorage/registry/sha256/0c/0c01110621e0ec1eded421406c9f117f7ae5486c8f7b0a0d1a37cc7bc9317226
2025-06-16 12:12:21 5.9 MiB datastorage/registry/sha256/20/20d0b4e6a2e6295e295119126082b4f39882f50278611e48580e8fbef730b08a
2025-06-16 12:11:03 1.4 KiB datastorage/registry/sha256/27/27941809078cc9b2802deb2b0bb6feed6c236cde01e487f200e24653533701ee
2025-06-16 12:12:25 22.9 MiB datastorage/registry/sha256/3b/3b1eb73e993990490aa137c00e60ff4ca9d1715bafb8e888dbb0986275edb13f
2025-06-16 12:12:19 6.2 KiB datastorage/registry/sha256/3b/3b29f43b7fff1f92cbea7613c52afd7725af4fec48621263114389b89b0a86bf
2025-06-16 12:11:07 29.0 MiB datastorage/registry/sha256/40/405f018f9d1d0f351c196b841a7c7f226fb8ea448acd6339a9ed8741600275a2
2025-06-16 12:12:51 201.6 MiB datastorage/registry/sha256/48/48b8862a18fa961ebfbac8484877dd4894e96ee88177d8c4f1f54d9727262b7d
2025-06-16 12:12:24 250 Bytes datastorage/registry/sha256/5c/5cc4a19fbac0d0fb7423535182443188713730a05b7ab1104f2116055472c13e
2025-06-16 12:46:59 1.5 KiB datastorage/registry/sha256/76/76e8b2c5c27d73b2b0752e5b90b81054aab23d5140b943cd9618d4f335074127
2025-06-16 12:12:27 26.1 MiB datastorage/registry/sha256/77/77a6ac598bc154025b4b2e393a3ca959116e0d8af9c31659a857ac05ab34ccbb
2025-06-16 12:14:21 12.0 MiB datastorage/registry/sha256/85/858ff9217c427e024d971e5b190e2b91d2e032273c2801738e3c519185c36625
2025-06-16 12:11:03 32 Bytes datastorage/registry/sha256/a3/a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4
2025-06-16 12:12:34 61.4 MiB datastorage/registry/sha256/b1/b1b8a0660a31403a35d70b276c3c86b1200b8683e83cd77a92ec98744017684a
2025-06-16 12:14:20 249 Bytes datastorage/registry/sha256/b1/b1c9952943a1f4f0fadf37eeae49cc2d264aa63fa27c9e7ab032a49a1b912d16
2025-06-16 12:14:20 449.4 KiB datastorage/registry/sha256/b2/b26c3d41364be873c41bcfc6338fd3a7dd25b9166f7a721f8f4af75c0de0f975
2025-06-16 12:14:19 5.1 KiB datastorage/registry/sha256/f3/f3abd857d733d39c00b904cafce4fc755edfd2909543489429ffcc6b80d3539b
2025-06-16 12:24:30 9.7 KiB datastorage/registry/sha256/fb/fbd9a209d4e84eaabbd6659520fef4f00b69474cbef0cd2166666a5459a44478
2025-06-16 12:14:20 3.6 MiB datastorage/registry/sha256/fe/fe07684b16b82247c3539ed86a65ff37a76138ec25d380bd80c869a1a4c73236
2025-06-16 12:12:31 61.4 MiB datastorage/registry/uploads/1202cfc1-31ee-4200-a1bd-87f296162bf9
2025-06-16 12:14:21 12.0 MiB datastorage/registry/uploads/154b1328-d943-4637-b265-2711a6c7f6b0
2025-06-16 12:12:23 22.9 MiB datastorage/registry/uploads/1bb911ff-2c28-4e87-82a6-bcaffcd76db7
2025-06-16 12:12:21 5.9 MiB datastorage/registry/uploads/1d13e288-8a82-43d2-aa3c-4383968c6af0
2025-06-16 12:11:02 1.4 KiB datastorage/registry/uploads/31f270fc-d2f9-42b8-91c5-8638188ad63d
2025-06-16 12:14:20 249 Bytes datastorage/registry/uploads/35a6160a-0179-41b8-9743-5a30d69ac352
2025-06-16 12:46:59 1.5 KiB datastorage/registry/uploads/3f7d4b4e-0ce5-493e-8d10-ea65c476ebad
2025-06-16 12:12:19 6.2 KiB datastorage/registry/uploads/64c8675c-8796-4be9-8835-d020ebf4d89e
2025-06-16 12:14:20 3.6 MiB datastorage/registry/uploads/7c42dffe-119e-4db7-961c-40fdb9efefc0
2025-06-16 12:12:44 201.6 MiB datastorage/registry/uploads/8b37d370-3c6f-4797-8f69-6a51e55a0270
2025-06-16 12:24:30 9.7 KiB datastorage/registry/uploads/91da1391-485c-4b40-9ff7-87bc6d005022
2025-06-16 12:12:25 26.1 MiB datastorage/registry/uploads/953e992e-635b-4d74-835d-f7602ae28954
2025-06-16 12:12:28 46.2 MiB datastorage/registry/uploads/a406ab1a-7eaa-4342-a90b-0712d9890741
2025-06-16 12:14:20 449.4 KiB datastorage/registry/uploads/dada2100-9f86-4b05-8c26-cb00659f27c9
2025-06-16 12:11:05 29.0 MiB datastorage/registry/uploads/dafa3e8d-9470-4bdf-a79c-e830e21f97a0
2025-06-16 12:14:19 5.1 KiB datastorage/registry/uploads/efafd92c-e1de-4ad3-a0ef-b80b3e1b9f6d
2025-06-16 12:12:23 250 Bytes datastorage/registry/uploads/fd2330a3-55bf-4d85-a74c-bac440cf2724
Total Objects: 35
Total Size: 818.4 MiB
