Uploaded image for project: 'Data Foundation Bugs'
  1. Data Foundation Bugs
  2. DFBUGS-3678

list-parts is not considering key in incomplete multipart uploads

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • odf-4.20
    • odf-4.20
    • noobaa-nc
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Committed
    • ?
    • ?
    • 4.20.0-80.konflux
    • Committed
    • Release Note Not Required
    • Important
    • None

       

      Description of problem - 
      In case, if multiple incomplete multipart uploads are present.
      If list-parts for a key is done for another valid upload-id then it is returning parts of upload-id and not giving error.

       

      The OCP platform infrastructure and deployment type (AWS, Bare Metal, VMware, etc. Please clarify if it is platform agnostic deployment), (IPI/UPI): N/A

       

      The ODF deployment type (Internal, External, Internal-Attached (LSO), Multicluster, DR, Provider, etc): Scale

       

       

      The version of all relevant components (OCP, ODF, RHCS, ACM whichever is applicable): 

      [root@blc-21 ~]# rpm -qi noobaa-core-5.20.0-20250705.el9.x86_64                                                                                                                                                   

      Name        : noobaa-core                                                                                                                                                                                         

      Version     : 5.20.0                                                                                                                                                                                              

      Release     : 20250705.el9                                                                                                                                                                                        

      Architecture: x86_64                                                                                                                                                                                              

      Install Date: Wed 16 Jul 2025 06:47:23 AM EDT                                                                                                                                                                     

      Group       : Unspecified                                                                                                                                                                                         

      Size        : 981394075                                                                                                                                                                                           

      License     : Apache-2.0                                                                                                                                                                                          

      Signature   : RSA/SHA256, Tue 08 Jul 2025 11:38:39 AM EDT, Key ID e1ecfb69c4c9e95d                                                                                                                                

      Source RPM  : noobaa-core-5.20.0-20250705.el9.src.rpm                                                                                                                                                             

      Build Date  : Sat 05 Jul 2025 03:31:19 AM EDT                                                                                                                                                                     

      Build Host  : rhel-8-medium-1264                                                                                                                                                                                  

      URL         : https://www.noobaa.io/                                                                                                                                                                              

      Summary     : NooBaa RPM                                                                                                                                                                                          

      Description :                                                                                                                                                                                                     

      NooBaa is a data service for cloud environments, providing S3 object-store interface with flexible tiering, mirroring, and spread placement policies, over any storage resource that allows GET/PUT including S3, G

      CS, Azure Blob, Filesystems, etc.                                                                                                                                                                                 

      [root@blc-21 ~]#

       

      Does this issue impact your ability to continue to work with the product? 

       

       

      Is there any workaround available to the best of your knowledge? No

       

       

      Can this issue be reproduced? If so, please provide the hit rate
      yes reproducible

       

      Can this issue be reproduced from the UI?

       

      If this is a regression, please provide more details to justify this:

       

      Steps to Reproduce:

      1. Initiate two incomplete multipart uploads - object1.txt object2.txt
      2. Upload parts to both incomplete mpu
      3. list parts using key object1.txt and upload-id of the object2.txt
        >>> This should return error. But here parts of object2.txt are getting listed

       

      The exact date and time when the issue was observed, including timezone details:

       

      Actual results:
      list-parts is listing the parts for given upload-id not considering the provided key.

       

      Expected results:

      list-parts should consider both upload-id and given key.

      Logs collected and log location:
      **

      [root@obj-sghadage-mgmt-host cluster]#  account_keys aws s3api  list-parts --bucket bucket-multipart15948 --endpoint  http://192.168.0.131:6001 --key test_object4.txt --upload-id 8a656d94-1be8-46d2-b87d-b3f4327b9376

      {

          "Parts": [

             

      {             "PartNumber": 2,             "LastModified": "2025-07-25T15:20:23+00:00",             "ETag": "\"mtime-dbl8kg4kcutc-ino-k1m\"",             "Size": 0         }

      ,

             

      {             "PartNumber": 1,             "LastModified": "2025-07-25T15:20:23+00:00",             "ETag": "\"mtime-dbl8kg3c1yww-ino-k1k\"",             "Size": 0         }

          ],

          "ChecksumAlgorithm": null,

          "Initiator":

      {         "ID": "123",         "DisplayName": "NooBaa"     }

      ,

          "Owner":

      {         "DisplayName": "NooBaa",         "ID": "123"     }

      ,

          "StorageClass": "STANDARD",

          "ChecksumType": null

      }

      [root@obj-sghadage-mgmt-host cluster]#

      Jul 28 02:55:17 blc-21 [66233]: 2025-07-28 02:55:17.955405 [PID-66233/TID-66352] [L1] FS::FSWorker::Execute: Stat _path=/mnt/gpfs0/account_account-15948/bucket-multipart15948/.noobaa-nsfs_6883a0b51b4cdf4a318f7c6

      4/multipart-uploads/8a656d94-1be8-46d2-b87d-b3f4327b9376/part-1  took: 0.175621 ms                                                                                                                                

      Jul 28 02:55:17 blc-21 [66233]: 2025-07-28 02:55:17.955526 [PID-66233/TID-66233] [L1] FS::Stat::OnOK: _path=/mnt/gpfs0/account_account-15948/bucket-multipart15948/.noobaa-nsfs_6883a0b51b4cdf4a318f7c64/multipart-

      uploads/8a656d94-1be8-46d2-b87d-b3f4327b9376/part-1 _stat_res.st_ino=25976 _stat_res.st_size=0                                                                                                                    

      Jul 28 02:55:17 blc-21 [66233]: [nsfs/66233]    [L1] core.util.http_utils:: HTTP REPLY XML GET /bucket-multipart15948/test_object4.txt?uploadId=8a656d94-1be8-46d2-b87d-b3f4327b9376

      {"host":"192.168.0.131:6001"," accept-encoding":"identity","user-agent":"aws-cli/2.24.18 md/awscrt#0.23.8 ua/2.1 os/linux#4.18.0-477.10.1.el8_8.x86_64 md/arch#x86_64 lang/python#3.12.9 md/pyimpl#CPython m/N,C cfg/retry-mode#standard md/instal ler#exe md/distrib#rhel.8 md/prompt#off md/command#s3api.list-parts","x-amz-date":"20250728T065517Z","x-amz-content-sha256":"e3b0c44298fc1c149afbf4c8996fb92427ae41e4649b934ca495991b7852b855","authorization":"AWS 4-HMAC-SHA256 Credential=Jlx94jFRBBYxDk0rYxSt/20250728/us-east-1/s3/aws4_request, SignedHeaders=host;x-amz-content-sha256;x-amz-date, Signature=8ea8928a192347d13bae47208bd6c5c4f76bd5bc8c7f6a212c18bc0b781ac3b9"}

      bucket-multipart15948test_object4.txt8a656d94-1be8-46d2-b87d-b3f4327b9

      376123NooBaa123NooBaaSTANDARD1000<PartNu

      mberMarker>0false20"mtime-dbl8kg4kcutc-ino-k1m"2025-07-25T15:20:23.000Z</LastModifie

      d>10"mtime-dbl8kg3c1yww-ino-k1k"2025-07-25T15:20:23.000Z                          

      Jul 28 02:55:17 blc-21 [66233]: 2025-07-28 02:55:17.958410 [PID-66233/TID-66233] [L1] FS::FSWorker::Begin: Stat _path=/mnt/cesSharedRoot/ces/s3-config/buckets/bucket-multipart15948.json                         

      Jul 28 02:55:17 blc-21 [66233]: 2025-07-28 02:55:17.958582 [PID-66233/TID-66354] [L1] FS::FSWorker::Execute: Stat _path=/mnt/cesSharedRoot/ces/s3-config/buckets/bucket-multipart15948.json _uid=0 _gid=0 _backend=

      GPFS supplemental_groups=                                                                                                                                                                                         

      Jul 28 02:55:17 blc-21 [66233]: 2025-07-28 02:55:17.958779 [PID-66233/TID-66354] [L1] FS::FSWorker::Execute: Stat _path=/mnt/cesSharedRoot/ces/s3-config/buckets/bucket-multipart15948.json _uid=0 _gid=0 geteuid()

      =0 getegid()=0 getuid()=0 getgid()=0 new_supplemental_groups=                                                                                                                                                     

      Jul 28 02:55:17 blc-21 [66233]: 2025-07-28 02:55:17.958885 [PID-66233/TID-66354] [L1] FS::FSWorker::Execute: Stat _path=/mnt/cesSharedRoot/ces/s3-config/buckets/bucket-multipart15948.json  took: 0.089811 ms    

      Jul 28 02:55:17 blc-21 [66233]: 2025-07-28 02:55:17.959163 [PID-66233/TID-66233] [L1] FS::Stat::OnOK: _path=/mnt/cesSharedRoot/ces/s3-config/buckets/bucket-multipart15948.json _stat_res.st_ino=28424 _stat_res.st

      _size=497                                                                                                                                                                                                         

      Jul 28 02:55:17 blc-21 [66233]: [nsfs/66233]    [L2] core.endpoint.s3.s3_bucket_logging:: read_bucket_sdk_config_info =   { _id: '6883a0b51b4cdf4a318f7c64', name: SENSITIVE-7f75eac553fdd417, owner_account:

      { id:  '6883a0a817b7cee13f302497', email: SENSITIVE-71a81f973308657b }

      , tag: [], versioning: 'DISABLED', creation_date: '2025-07-25T15:20:21.790Z', path: '/mnt/gpfs0/account_account-15948/bucket-multipart15948', shoul

      d_create_underlying_storage: false, fs_backend: 'GPFS', lifecycle_configuration_rules: [ { filter:

      { prefix: 'object' }

      , id: 'abort-multipart-days-file-prefix', status: 'Enabled', abort_incomplete_multipart_uplo

      ad: { days_after_initiation: 1 } } ], namespace: { read_resources: [ { resource:

      { fs_root_path: '', fs_backend: 'GPFS' }

      , path: '/mnt/gpfs0/account_account-15948/bucket-multipart15948' } ], write_resource:

      { re source: \{ fs_root_path: '', fs_backend: 'GPFS' }

      , path: '/mnt/gpfs0/account_account-15948/bucket-multipart15948' }, should_create_underlying_storage: false }, bucket_info:

      { versioning: 'DISABLED', logging: unde fined }

      , bucket_owner: SENSITIVE-71a81f973308657b, supported_storage_classes: [ 'STANDARD' ], stat: { dev: 44, ino: 28424, mode: 33200, nlink: 1, uid: 0, gid: 0, rdev: 0, size: 497, blksize: 1048576, blocks: 16,

       atimeMs: 1753683556275.0369, ctimeMs: 1753456822138.11, mtimeMs: 1753456822137.1555, birthtimeMs: 1753456822138.11, atime: 2025-07-28T06:19:16.275Z, mtime: 2025-07-25T15:20:22.137Z, ctime: 2025-07-25T15:20:22.1

      38Z, birthtime: 2025-07-25T15:20:22.138Z, atimeNsBigint: 1753683556275036928n, ctimeNsBigint: 1753456822138109952n, mtimeNsBigint: 1753456822137155584n, xattr:

      { 'security.selinux': 'system_u:object_r:unlabeled_ t:s0\x00' }

      } }                                                                                                                                                                                                   

      Jul 28 02:55:27 blc-21 node[73857]: 2025-07-28 02:55:27.677221 [PID-73857/TID-73857] [L1] FS::set_log_config: LOG_TO_STDERR_ENABLED=0 LOG_TO_SYSLOG_ENABLED=1                                                     

      Jul 28 02:55:27 blc-21 [66233]: [nsfs/66233]    [L0] core.sdk.endpoint_stats_collector:: nsfs stats - IO counters : undefined 

       

       

      Additional info:

       
       

              jalbo@redhat.com Jacky Albo
              snehalibm Snehal Ghadage (Inactive)
              Jacky Albo
              Sagi Hirshfeld Sagi Hirshfeld
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

                Created:
                Updated: