Uploaded image for project: 'Red Hat OpenStack Services on OpenShift'
  1. Red Hat OpenStack Services on OpenShift
  2. OSPRH-23902

Request DB modifications to deal with mismatch volume

XMLWordPrintable

    • Icon: Story Story
    • Resolution: Unresolved
    • Icon: Blocker Blocker
    • None
    • None
    • None
    • False
    • Hide

      None

      Show
      None
    • False
    • Not Selected

      Goal: 

       
      Customer tried to correct the volume mismatch of instance b6507ca5-a1de-40b2-ab58-431683462b84

       [root@overcloud-ctl-1 ~]# openstack server show b6507ca5-a1de-40b2-ab58-431683462b84 --fit
      +-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | Field                               | Value                                                                                                                                                               |
      +-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+
      | OS-DCF:diskConfig                   | MANUAL                                                                                                                                                              |
      | OS-EXT-AZ:availability_zone         |                                                                                                                                                                     |
      | OS-EXT-SRV-ATTR:host                | None                                                                                                                                                                |
      | OS-EXT-SRV-ATTR:hypervisor_hostname | None                                                                                                                                                                |
      | OS-EXT-SRV-ATTR:instance_name       | instance-00000a02                                                                                                                                                   |
      | OS-EXT-STS:power_state              | NOSTATE                                                                                                                                                             |
      | OS-EXT-STS:task_state               | None                                                                                                                                                                |
      | OS-EXT-STS:vm_state                 | error                                                                                                                                                               |
      | OS-SRV-USG:launched_at              | None                                                                                                                                                                |
      | OS-SRV-USG:terminated_at            | None                                                                                                                                                                |
      | accessIPv4                          |                                                                                                                                                                     |
      | accessIPv6                          |                                                                                                                                                                     |
      | addresses                           |                                                                                                                                                                     |
      | config_drive                        |                                                                                                                                                                     |
      | created                             | 2025-12-16T06:26:42Z                                                                                                                                                |
      | fault                               | {'code': 500, 'created': '2025-12-16T06:26:59Z', 'message': 'Build of instance b6507ca5-a1de-40b2-ab58-431683462b84 aborted: Unable to update attachment.(Invalid   |
      |                                     | volume: duplicate connectors detected on volume 37dc4621-99ec-4238-aa04-266ae4cda902). (HTTP 500) (Request-ID: req-7dd9603f-4200-428d-a0f8-81bce52dfb32)',          |
      |                                     | 'details': 'Traceback (most recent call last):\n  File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 1976, in _prep_block_device\n               |
      |                                     | driver_block_device.attach_block_devices(\n  File "/usr/lib/python3.9/site-packages/nova/virt/block_device.py", line 874, in attach_block_devices\n                 |
      |                                     | _log_and_attach(device)\n  File "/usr/lib/python3.9/site-packages/nova/virt/block_device.py", line 871, in _log_and_attach\n    bdm.attach(*attach_args,            |
      |                                     | **attach_kwargs)\n  File "/usr/lib/python3.9/site-packages/nova/virt/block_device.py", line 46, in wrapped\n    ret_val = method(obj, context, *args, **kwargs)\n   |
      |                                     | File "/usr/lib/python3.9/site-packages/nova/virt/block_device.py", line 672, in attach\n    self._do_attach(context, instance, volume, volume_api,\n  File          |
      |                                     | "/usr/lib/python3.9/site-packages/nova/virt/block_device.py", line 657, in _do_attach\n    self._volume_attach(context, volume, connector, instance,\n  File        |
      |                                     | "/usr/lib/python3.9/site-packages/nova/virt/block_device.py", line 571, in _volume_attach\n    connection_info = volume_api.attachment_update(\n  File              |
      |                                     | "/usr/lib/python3.9/site-packages/nova/volume/cinder.py", line 397, in wrapper\n    res = method(self, ctx, *args, **kwargs)\n  File "/usr/lib/python3.9/site-      |
      |                                     | packages/nova/volume/cinder.py", line 448, in wrapper\n    res = method(self, ctx, attachment_id, *args, **kwargs)\n  File "/usr/lib/python3.9/site-                |
      |                                     | packages/nova/volume/cinder.py", line 878, in attachment_update\n    LOG.error(\'Update attachment failed for attachment \'\n  File "/usr/lib/python3.9/site-       |
      |                                     | packages/oslo_utils/excutils.py", line 227, in __exit__\n    self.force_reraise()\n  File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in   |
      |                                     | force_reraise\n    raise self.value\n  File "/usr/lib/python3.9/site-packages/nova/volume/cinder.py", line 870, in attachment_update\n    attachment_ref =          |
      |                                     | cinderclient(\n  File "/usr/lib/python3.9/site-packages/cinderclient/api_versions.py", line 423, in substitution\n    return method.func(obj, *args, **kwargs)\n    |
      |                                     | File "/usr/lib/python3.9/site-packages/cinderclient/v3/attachments.py", line 75, in update\n    resp = self._update(\'/attachments/%s\' % id, body)\n  File         |
      |                                     | "/usr/lib/python3.9/site-packages/cinderclient/base.py", line 312, in _update\n    resp, body = self.api.client.put(url, body=body, **kwargs)\n  File               |
      |                                     | "/usr/lib/python3.9/site-packages/cinderclient/client.py", line 220, in put\n    return self._cs_request(url, \'PUT\', **kwargs)\n  File "/usr/lib/python3.9/site-  |
      |                                     | packages/cinderclient/client.py", line 205, in _cs_request\n    return self.request(url, method, **kwargs)\n  File "/usr/lib/python3.9/site-                        |
      |                                     | packages/cinderclient/client.py", line 191, in request\n    raise exceptions.from_response(resp, body)\ncinderclient.exceptions.ClientException: Unable to update   |
      |                                     | attachment.(Invalid volume: duplicate connectors detected on volume 37dc4621-99ec-4238-aa04-266ae4cda902). (HTTP 500) (Request-ID:                                  |
      |                                     | req-7dd9603f-4200-428d-a0f8-81bce52dfb32)\n\nDuring handling of the above exception, another exception occurred:\n\nTraceback (most recent call last):\n  File      |
      |                                     | "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 2625, in _build_resources\n    block_device_info = self._prep_block_device(context, instance,\n    |
      |                                     | File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 1996, in _prep_block_device\n    raise                                                        |
      |                                     | exception.InvalidBDM(str(ex))\nnova.exception.InvalidBDM: Unable to update attachment.(Invalid volume: duplicate connectors detected on volume                      |
      |                                     | 37dc4621-99ec-4238-aa04-266ae4cda902). (HTTP 500) (Request-ID: req-7dd9603f-4200-428d-a0f8-81bce52dfb32)\n\nDuring handling of the above exception, another         |
      |                                     | exception occurred:\n\nTraceback (most recent call last):\n  File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 2235, in                         |
      |                                     | _do_build_and_run_instance\n    self._build_and_run_instance(context, instance, image,\n  File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line     |
      |                                     | 2450, in _build_and_run_instance\n    compute_utils.notify_about_instance_create(\n  File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in   |
      |                                     | __exit__\n    self.force_reraise()\n  File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise\n    raise self.value\n  File      |
      |                                     | "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line 2401, in _build_and_run_instance\n    with self._build_resources(context, instance,\n  File        |
      |                                     | "/usr/lib64/python3.9/contextlib.py", line 119, in __enter__\n    return next(self.gen)\n  File "/usr/lib/python3.9/site-packages/nova/compute/manager.py", line    |
      |                                     | 2635, in _build_resources\n    raise exception.BuildAbortException(instance_uuid=instance.uuid,\nnova.exception.BuildAbortException: Build of instance              |
      |                                     | b6507ca5-a1de-40b2-ab58-431683462b84 aborted: Unable to update attachment.(Invalid volume: duplicate connectors detected on volume                                  |
      |                                     | 37dc4621-99ec-4238-aa04-266ae4cda902). (HTTP 500) (Request-ID: req-7dd9603f-4200-428d-a0f8-81bce52dfb32)\n'}                                                        |
      | flavor                              | 8c16g200gdisk (78bcae7d-2c72-4b9a-bbe2-dde079c347a2)                                                                                                                |
      | hostId                              |                                                                                                                                                                     |
      | id                                  | b6507ca5-a1de-40b2-ab58-431683462b84                                                                                                                                |
      | image                               | N/A (booted from volume)                                                                                                                                            |
      | key_name                            | None                                                                                                                                                                |
      | name                                | comm-3                                                                                                                                                              |
      | project_id                          | 4cc1975d23544236858f0a1335d7e7c8                                                                                                                                    |
      | properties                          |                                                                                                                                                                     |
      | status                              | ERROR                                                                                                                                                               |
      | updated                             | 2025-12-16T06:27:00Z                                                                                                                                                |
      | user_id                             | f6de8d93e551453099273d87dc95166d                                                                                                                                    |
      | volumes_attached                    | id='37dc4621-99ec-4238-aa04-266ae4cda902'                                                                                                                           |
      +-------------------------------------+---------------------------------------------------------------------------------------------------------------------------------------------------------------------+ 

      And the volume attach to non-exist instance 93315f25-770a-485b-b512-26ca1ce69836

      # cinder --os-volume-api-version 3.59 attachment-list --all-tenants --volume-id 37dc4621-99ec-4238-aa04-266ae4cda902
      +--------------------------------------+--------------------------------------+----------+--------------------------------------+
      | ID                                   | Volume ID                            | Status   | Server ID                            |
      +--------------------------------------+--------------------------------------+----------+--------------------------------------+
      | 90164f3d-25b2-4743-b761-71d94114ce56 | 37dc4621-99ec-4238-aa04-266ae4cda902 | attached | 93315f25-770a-485b-b512-26ca1ce69836 |
      +--------------------------------------+--------------------------------------+----------+--------------------------------------+
      

              Unassigned Unassigned
              rhn-support-jiehuang Huang Jie yu
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: