-
Bug
-
Resolution: Unresolved
-
Critical
-
4.18
-
-
-
Important
-
Yes
-
Approved
-
False
-
-
Release Note Not Required
-
In Progress
Description of problem:
Running https://github.com/shiftstack/installer/blob/master/docs/user/openstack/README.md#openstack-credentials-update leads to cinder pvc stuck in terminating status:
$ oc get pvc -A NAMESPACE NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS VOLUMEATTRIBUTESCLASS AGE cinder-test pvc-0 Terminating pvc-d7d37d04-d8d1-4a61-a3bc-c038e53a13c7 1Gi RWO standard-csi <unset> 12h cinder-test pvc-1 Terminating pvc-32049f0e-b842-4e54-aff8-5f41f51b3c54 1Gi RWO standard-csi <unset> 12h cinder-test pvc-2 Terminating pvc-3eb42d8a-f22f-418b-881e-21c913b89c56 1Gi RWO standard-csi <unset> 12h
The cinder-csi-controller reports below error:
E1022 07:21:11.772540 1 utils.go:95] [ID:4401] GRPC error: rpc error: code = Internal desc = DeleteVolume failed with error Expected HTTP response code [202 204] when accessing [DELETE https://10.46.44.159:13776/v3/c27fbb9d859e40cc9 6f82e47b5ceebd6/volumes/bd5e6cf9-f27e-4aff-81ac-a83e7bccea86], but got 400 instead: {"badRequest": {"code": 400, "message": "Invalid volume: Volume status must be available or error or error_restoring or error_extending or error_managing and must not be migrating, attached, belong to a group, have snapshots or be disassociated from snapshots after volume transfer."}}
However, in openstack, they appears in-use:
stack@undercloud-0 ~]$ OS_CLOUD=shiftstack openstack volume list
/usr/lib/python3.9/site-packages/osc_lib/utils/__init__.py:515: DeprecationWarning: The usage of formatter functions is now discouraged. Consider using cliff.columns.FormattableColumn instead. See reviews linked with bug 1687955 for more
detail.
warnings.warn(
+--------------------------------------+------------------------------------------+-----------+------+------------------------------------------------------+
| ID | Name | Status | Size | Attached to |
+--------------------------------------+------------------------------------------+-----------+------+------------------------------------------------------+
| 093b14c1-a79a-46aa-ab6b-6c71d2adcef9 | pvc-3eb42d8a-f22f-418b-881e-21c913b89c56 | in-use | 1 | Attached to ostest-2nkmx-worker-0-cflkl on /dev/vdd |
| 4342c947-732d-4d23-964c-58bd56b79fd4 | pvc-32049f0e-b842-4e54-aff8-5f41f51b3c54 | in-use | 1 | Attached to ostest-2nkmx-worker-0-cflkl on /dev/vdc |
| 6da3147f-4ce8-4e17-a29a-6f311599a969 | pvc-d7d37d04-d8d1-4a61-a3bc-c038e53a13c7 | in-use | 1 | Attached to ostest-2nkmx-worker-0-cflkl on /dev/vdb |
Version-Release number of selected component (if applicable):
4.18.0-0.nightly-2024-10-21-010606 RHOS-17.1-RHEL-9-20240701.n.1
How reproducible:
Always (twice in a row)
Additional info:
must-gather provided in private comment
