Uploaded image for project: 'Project Quay'
  1. Project Quay
  2. PROJQUAY-6450

org was cleaned and tag doesn't upload when "Quota has been exceeded on namespace"

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • quay-v3.10.0
    • quay
    • False
    • None
    • False
    • Rejected

      Description:

      With enable proxy cache, when pull image exceed Quota limitation, image doesn't upload successful while org is cleaned.

      Index Image:

      quay-operator-bundle-container-v3.10.0-151

      Index image v4.14: registry-proxy.engineering.redhat.com/rh-osbs/iib:622241

       

      Steps:

      1, Deploy Quay registry with

      FEATURE_QUOTA_MANAGEMENT: true
      FEATURE_PROXY_CACHE: true

      2, Create a repo name it "cache-quayio" set Org Quota: 500m, set Proxy Cache: quay.io/quay-qetest with workable credential

      3, Pull 2 image tags from proxy organization,

      wordpress_php8.0_layers_20_tag_19   size   190M    ->SmallTag
      nextcloud_fpm_layers_20_tag_20      size   319M    ->BigTag    

      big size tag:

      small size tag:

      4, podman pull BigTag, then podman pull SmallTag, works fine, BigTag first uploaded in cache-quayio repo then immediately replaced with SmallTag,

      5, continue podman pull BigTag, now expect behavior is: BigTag replace SamllTag in cache-quayio repo

       

      Actual Result: (always)

      It cleaned org cache-quayio, but BigTag doesn't listed on the repo

      seanzhao@seanzhaos-MacBook-Pro % podman pull quayregistry-quay-quay-enterprise-14492.apps.quaytest-14492.qe.azure.devcluster.openshift.com/cache-quayio/clair-load-test:wordpress_php8.0_layers_20_tag_19 --tls-verify=false --arch=amd64
      
      seanzhao@seanzhaos-MacBook-Pro % podman pull quayregistry-quay-quay-enterprise-14492.apps.quaytest-14492.qe.azure.devcluster.openshift.com/cache-quayio/clair-load-test:nextcloud_fpm_layers_20_tag_20 --tls-verify=false --arch=amd64
      Trying to pull quayregistry-quay-quay-enterprise-14492.apps.quaytest-14492.qe.azure.devcluster.openshift.com/cache-quayio/clair-load-test:nextcloud_fpm_layers_20_tag_20...
      Error: initializing source docker://quayregistry-quay-quay-enterprise-14492.apps.quaytest-14492.qe.azure.devcluster.openshift.com/cache-quayio/clair-load-test:nextcloud_fpm_layers_20_tag_20: reading manifest nextcloud_fpm_layers_20_tag_20 in quayregistry-quay-quay-enterprise-14492.apps.quaytest-14492.qe.azure.devcluster.openshift.com/cache-quayio/clair-load-test: denied: Quota has been exceeded on namespace
       

      Symptom:

      During podman pull, Small size image can immediately replace Big size image, but not vice versa 

       

      config.yaml

      BROWSER_API_CALLS_XHR_ONLY: false
      CREATE_PRIVATE_REPO_ON_PUSH: true
      CREATE_NAMESPACE_ON_PUSH: true
      FEATURE_QUOTA_MANAGEMENT: true
      FEATURE_PROXY_CACHE: true
      CREATE_REPOSITORY_ON_PUSH_PUBLIC: true
      FEATURE_EXTENDED_REPOSITORY_NAMES: true
      FEATURE_USER_INITIALIZE: true
      FEATURE_GENERAL_OCI_SUPPORT: true
      FEATURE_HELM_OCI_SUPPORT: true
      FEATURE_PROXY_STORAGE: true
      PERMANENTLY_DELETE_TAGS: true
      SUPER_USERS:
        - quay
        - admin
      DISTRIBUTED_STORAGE_CONFIG:
          default:
            - AzureStorage
            - azure_account_key: xxxx
              azure_account_name: quayazure14492
              azure_container: quayazure14492
              sas_token: xxx
              storage_path: /quayazuredata/quayregistry
      DISTRIBUTED_STORAGE_DEFAULT_LOCATIONS:
        - default
      DISTRIBUTED_STORAGE_PREFERENCE:
        - default
      FEATURE_UI_V2: true
      FEATURE_SUPERUSERS_FULL_ACCESS: true
      FEATURE_AUTO_PRUNE: true
      FEATURE_UI_V2_REPO_SETTINGS: true 

       

      Video is attached.

        1. image-2023-11-28-16-19-53-258.png
          60 kB
          Sean Zhao
        2. image-2023-11-28-16-23-55-692.png
          38 kB
          Sean Zhao
        3. pullimages.mov
          136.13 MB
          Sean Zhao

              Unassigned Unassigned
              szhao@redhat.com Sean Zhao
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: