Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-9729

[Dell PowerStore NFS driver] 'tempest.scenario.test_volume_backup_restore.TestVolumeBackupRestore' keeps failing due to recent fix for CVE-2024-32498 in patch 923244

XMLWordPrintable

    • False
    • Hide

      None

      Show
      None
    • False
    • ?
    • ?
    • ?
    • ?
    • None
    • Important

      1. Dell PowerStore NFS driver CI [1] 'tempest.scenario.test_volume_backup_restore.TestVolumeBackupRestore.test_volume_backup_restore' fails on:
      Traceback (most recent call last):
        File "/opt/stack/new/tempest/tempest/common/utils/_init_.py", line 65, in wrapper
          return f(*func_args, **func_kwargs)
        File "/opt/stack/new/tempest/tempest/scenario/test_volume_backup_restore.py", line 83, in test_volume_backup_restore
          server = self.create_server(image_id='',
        File "/opt/stack/new/tempest/tempest/scenario/manager.py", line 349, in create_server
          body, _ = compute.create_test_server(
        File "/opt/stack/new/tempest/tempest/common/compute.py", line 340, in create_test_server
          with excutils.save_and_reraise_exception():
        File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 227, in _exit_
          self.force_reraise()
        File "/usr/local/lib/python3.10/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise
          raise self.value
        File "/opt/stack/new/tempest/tempest/common/compute.py", line 323, in create_test_server
          server = waiters.wait_for_server_status(
        File "/opt/stack/new/tempest/tempest/common/waiters.py", line 80, in wait_for_server_status
          raise exceptions.BuildErrorException(details, server_id=server_id)
      tempest.exceptions.BuildErrorException: Server 83e1cddd-5188-40f7-82d6-a9fe23543b17 failed to build and is in ERROR status
      Details: Fault: {'code': 500, 'created': '2024-07-09T07:21:23Z', 'message': 'Build of instance 83e1cddd-5188-40f7-82d6-a9fe23543b17 aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Driver initialize connection failed (error: Invalid volume: The volume virtual_size does not match'}. Request ID of server operation performed before checking the server status req-e43b7f58-dbeb-4b31-a769-d5916810c1d5.

      2. The error in c-vol log [2]:
      Jul 09 13:38:08.068016 e2e-os-pstorenfs152 cinder-volume[323493]: ERROR cinder.volume.drivers.nfs [req-73548328-3857-4347-88e4-5cd03c119591 req-f899fda9-51a3-4cc3-971b-d928bf99e685 tempest-TestVolumeBackupRestore-987350038 None] The volume virtual_size does not match the size in cinder, aborting as we suspect an exploit. Virtual Size is 117440512 and real size is 1
      Jul 09 13:38:08.077514 e2e-os-pstorenfs152 cinder-volume[323493]: ERROR cinder.volume.manager [req-73548328-3857-4347-88e4-5cd03c119591 req-f899fda9-51a3-4cc3-971b-d928bf99e685 tempest-TestVolumeBackupRestore-987350038 None] Driver initialize connection failed (error: Invalid volume: The volume virtual_size does not match the size in cinder, aborting as we suspect an exploit.).: cinder.exception.InvalidVolume: Invalid volume: The volume virtual_size does not match the size in cinder, aborting as we suspect an exploit.

      3. This issue can be reproduced manually by steps:
         (1) Create a '1GB' PowerStore volume from image 'cirros-0.6.2-x86_64-disk'.
         (2) Create a backup for the volume.
         (3) Restore the backup.
         (4) Boot a server from the restored backup.
      In step (4), the error occurred:
      Jul 16 08:49:21 vpi6189 cinder-volume[307026]: ERROR cinder.volume.manager [req-d6fe9dcb-252a-4b90-8d23-ea60f433aa46 req-2bb5fd8b-18a4-45d6-9f25-8cb3d0e582fc demo None] Driver initialize connection failed (error: Invalid volume: The volume virtual_size does not match the size in cinder, aborting as we suspect an exploit.).: cinder.exception.InvalidVolume: Invalid volume: The volume virtual_size does not match the size in cinder, aborting as we suspect an exploit.

      4. The check of 'virtual_size' and 'size' was added in patch [3] 923244: CVE-2024-32498: Check for external qcow2 data file.

      ========================================================================================================
      [1] https://elab-os-logsrv.delllabs.net/46/923346/1/check/DellEMC_PowerStore_NFS/58ed778/DellEMC_PowerStore_NFS/1189/logs/ci_log/testr_results.html

      [2] https://elab-os-logsrv.delllabs.net/46/923346/1/check/DellEMC_PowerStore_NFS/58ed778/DellEMC_PowerStore_NFS/1189/logs/ci_log/screen-c-vol.txt.gz

      [3] https://review.opendev.org/c/openstack/cinder/+/923244

            brosmait@redhat.com Brian Rosmaita
            udesale@redhat.com Unmesh Desale
            rhos-dfg-storage-squad-cinder
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: