Uploaded image for project: 'OpenShift Bugs'
  1. OpenShift Bugs
  2. OCPBUGS-38085

Multipart upload issues with Cloudflare R2 using S3 api

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Major Major
    • None
    • 4.17
    • Image Registry
    • None
    • Rejected
    • False
    • Hide

      None

      Show
      None
    • Release Note Not Required
    • In Progress

      Description of problem:

      Multipart upload issues with Cloudflare R2 using S3 api. Some S3 compatible object storage systems like R2 require that all multipart chunks are the same size. This was mostly true before, except the final chunk was larger than the requested chunk size which causes uploads to fail.

      Version-Release number of selected component (if applicable):

          

      How reproducible:

          Problem shows itself on OpenShift CI clusters intermittently.

      Steps to Reproduce:

      This behavior has been causing 504 Gateway Timeout issues in the image registry instances in OpenShift CI clusters.
      It is connected to uploading big images (i.e 35GB), but we do not currently have the exact steps that reproduce it.
      
          1.
          2.
          3.
          

      Actual results:

          

      Expected results:

          

      Additional info:

          https://github.com/distribution/distribution/issues/3873 
          https://github.com/distribution/distribution/issues/3873#issuecomment-2258926705
          https://developers.cloudflare.com/r2/api/workers/workers-api-reference/#r2multipartupload-definition (look for "uniform in size")

              rh-ee-dmistry Deep Mistry
              rh-ee-dmistry Deep Mistry
              Wen Wang Wen Wang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated: