Loading...

XML

Word

Printable

Type: Bug
Resolution: Done-Errata
Priority: Major
Fix Version/s: CNV v4.17.3
Affects Version/s: CNV v4.17.3
Component/s: Storage Platform
Labels:
None

Story Points:
3
Blocked:
False
Blocked Reason:

Hide

None

Show
None
Ready:
False
Component Fix Version(s):
CNV v4.17.3.rhel9-58
Git Pull Request:
https://github.com/kubevirt/hostpath-provisioner-operator/pull/549
[QE] How to address?:
---
[QE] Why QE missed?:
---
Market:

Sprint:
CNV Storage 264

Regression:
None

SFDC Cases Links:
SFDC Cases Counter:
SFDC Cases Open:

Description of problem:

rhn-support-dbasunag noticed, that in some clusters, PVs are stuck Terminating. While all DVs are Succeeded and all PVCs are Bound.

Version-Release number of selected component (if applicable):

OCP-4.18.0-rc.2
CNV-v4.18.0.rhel9-531

OCP-4.18.0-rc.2
CNV-v4.18.0.rhel9-542

How reproducible:

Saw in two clusters, 
but also saw healthy clusters with the same OCP rc2 + closest CNV buils

Steps to Reproduce:

1. Deploy CNV
2. Install HPP (haven't tried with OCS) 
   2.1. make HPP default and virt-default SC
3. Wait for the boot source images to import
4. Look at the PVs

Actual results:

Terminating PVs for 10+ hours

$ oc get pv
NAME                                       CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS        CLAIM                                                                                   STORAGECLASS         VOLUMEATTRIBUTESCLASS   REASON   AGE
local-pv-1b55aae6                          70Gi       RWO            Delete           Bound         openshift-storage/ocs-deviceset-0-data-1txtx6                                           local-block-ocs      <unset>                          32h
local-pv-6861f38                           70Gi       RWO            Delete           Bound         openshift-cnv/hpp-pool-hpp-csi-pvc-block-c01-dbn-418-trdb4-worker-0-vwv6q               local-block-hpp      <unset>                          32h
local-pv-75c12a                            70Gi       RWO            Delete           Bound         openshift-storage/ocs-deviceset-0-data-0rh8r5                                           local-block-ocs      <unset>                          32h
local-pv-9ec128e9                          70Gi       RWO            Delete           Bound         openshift-storage/ocs-deviceset-0-data-28v4xt                                           local-block-ocs      <unset>                          32h
local-pv-ac3d1018                          70Gi       RWO            Delete           Bound         openshift-cnv/hpp-pool-hpp-csi-pvc-block-c01-dbn-418-trdb4-worker-0-tjnb4               local-block-hpp      <unset>                          32h
local-pv-b1aa2009                          70Gi       RWO            Delete           Bound         openshift-cnv/hpp-pool-hpp-csi-pvc-block-c01-dbn-418-trdb4-worker-0-drbdq               local-block-hpp      <unset>                          32h
pvc-168832af-d65f-40d6-b987-40a2f45f53ce   149Gi      RWO            Delete           Bound         openshift-virtualization-os-images/rhel9-81173ee547d4                                   hostpath-csi-basic   <unset>                          32h
pvc-22d3f359-2550-4de8-b1d7-efb44df756d3   149Gi      RWO            Delete           Terminating   openshift-virtualization-os-images/prime-19ee9099-e1b0-4837-ae5c-ff9ac7b2c239           hostpath-csi-basic   <unset>                          32h
pvc-30058d03-c4fb-46ba-9131-34faa4ed4dc5   149Gi      RWO            Delete           Terminating   openshift-virtualization-os-images/prime-7a21bb41-131a-433d-9eeb-f60fd89e1e83-scratch   hostpath-csi-basic   <unset>                          23h
pvc-442fcec7-d658-4bc0-a2a1-7868dc43d590   149Gi      RWO            Delete           Bound         openshift-virtualization-os-images/rhel10-beta-41e4c3e6f5a3                             hostpath-csi-basic   <unset>                          32h
pvc-45bfe11e-d5e3-4275-8df0-652f84de15a7   149Gi      RWO            Delete           Terminating   cdi-import-test-import-htt/prime-bf7503d1-2a81-455f-b2ba-fff8ffd505af-scratch           hostpath-csi-basic   <unset>                          23h
pvc-4f82b214-f5c9-440d-a094-2a09e6db56f7   149Gi      RWO            Delete           Terminating   openshift-virtualization-os-images/prime-ca26a9fc-2a8d-4143-a59c-e56bdc1af32e           hostpath-csi-basic   <unset>                          32h
pvc-61f46cd0-bf98-40a9-8d35-19c60ebc4ebc   149Gi      RWO            Delete           Bound         openshift-virtualization-os-images/fedora-fee3d6a527c8                                  hostpath-csi-basic   <unset>                          32h
pvc-69cf23be-6e29-44dd-98fe-8ed41909d69c   149Gi      RWO            Delete           Terminating   cdi-upload-test-upload-virtctl/prime-18f51a36-1181-44cd-b2d0-5aa8aad55848-scratch       hostpath-csi-basic   <unset>                          23h
pvc-890c6b94-17cb-41ed-a8cb-f9267e0c0389   149Gi      RWO            Delete           Bound         openshift-virtualization-os-images/rhel8-c2e42994fa75                                   hostpath-csi-basic   <unset>                          17h
pvc-9a35886f-1c5e-4f96-a20f-ce5bfcc22331   149Gi      RWO            Delete           Bound         openshift-virtualization-os-images/centos-stream10-29a8d89c07aa                         hostpath-csi-basic   <unset>                          32h
pvc-9caa5837-b8f9-47fd-9822-e57fb40828e3   149Gi      RWO            Delete           Terminating   cdi-clone-test-clone/prime-e30df5f3-ed63-4e0e-8291-65bfda908270-scratch                 hostpath-csi-basic   <unset>                          23h
pvc-aa75e621-e530-455b-b1b6-bf557e0017e8   149Gi      RWO            Delete           Bound         openshift-virtualization-os-images/rhel9-b980710c925f                                   hostpath-csi-basic   <unset>                          17h
pvc-ba259493-11b0-4a41-b6f8-7608a0c00511   149Gi      RWO            Delete           Bound         openshift-virtualization-os-images/rhel8-a4f11df886b2                                   hostpath-csi-basic   <unset>                          32h
pvc-ba77856a-8a1e-4abf-9fa6-0450403e9d14   149Gi      RWO            Delete           Terminating   cdi-import-test-import-registr/prime-ca2a0c1b-1288-4bfd-97fe-112ed5d77a2f-scratch       hostpath-csi-basic   <unset>                          23h
pvc-e60f0f4f-7c9a-4630-aa75-73a2bc5f2d7c   149Gi      RWO            Delete           Bound         openshift-virtualization-os-images/centos-stream9-2497db40581f                          hostpath-csi-basic   <unset>                          32h
pvc-ebd12e93-d81b-410f-ae7f-97549af253e6   149Gi      RWO            Delete           Terminating   openshift-virtualization-os-images/prime-9af42373-1e30-486e-9167-2de76a0828e8           hostpath-csi-basic   <unset>

Expected results:

No Terminating PVs

Additional info:

When we list the PVs, it shows status 'Terminating', but in the -oyaml it shows "phase: Released"

$ oc get pv pvc-ebd12e93-d81b-410f-ae7f-97549af253e6 
NAME                                       CAPACITY   ACCESS MODES   RECLAIM POLICY   STATUS        CLAIM                                                                           STORAGECLASS         VOLUMEATTRIBUTESCLASS   REASON   AGE
pvc-ebd12e93-d81b-410f-ae7f-97549af253e6   149Gi      RWO            Delete           Terminating   openshift-virtualization-os-images/prime-9af42373-1e30-486e-9167-2de76a0828e8   hostpath-csi-basic   <unset>                          32h

$ oc get pv pvc-ebd12e93-d81b-410f-ae7f-97549af253e6 -oyaml | grep phase
  phase: Released

clones

CNV-53956 [4.18] PVs of the prime and scratch PVCs are stuck Terminating

Verified

links to

RHEA-2024:143877 OpenShift Virtualization 4.17.3 Images

Assignee:: Alex Kalenyuk

Reporter:: Jenia Peimer

QA Contact:: Jenia Peimer

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Created:: 2024/12/19 1:52 PM

Updated:: 2025/01/07 9:44 PM

Resolved:: 2025/01/07 9:44 PM

Details

Description

Attachments

Issue Links

Easy Agile Planning Poker

Activity

People

Dates