Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-31071

[2223361] PVCs prime are not cleaned up and stay in the 'Lost ' Phase

XMLWordPrintable

    • High
    • No

      Description of problem:
      PVCs prime in 'Lost' phase in openshift-virtualization-os-images namespace

      Version-Release number of selected component (if applicable):
      CNV v4.14.0.rhel9-1259

      How reproducible:
      Always

      Steps to Reproduce:
      0. Install CNV, set 'hostpath-csi-basic' storage as default (CSI, RWO, FS), wait for boot source images to import

      1. $ oc get pvc -A
      NAMESPACE NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE
      openshift-cnv hpp-pool-hpp-csi-pvc-block-c01-jp414-qfjfs-worker-0-f6qmc Bound local-pv-fc7f621c 70Gi RWO local-block-hpp 31m
      openshift-cnv hpp-pool-hpp-csi-pvc-block-c01-jp414-qfjfs-worker-0-tw5x9 Bound local-pv-26adfea1 70Gi RWO local-block-hpp 31m
      openshift-cnv hpp-pool-hpp-csi-pvc-block-c01-jp414-qfjfs-worker-0-w2m6l Bound local-pv-33924ef7 70Gi RWO local-block-hpp 31m
      openshift-storage ocs-deviceset-0-data-052fbd Bound local-pv-7e381611 70Gi RWO local-block-ocs 38m
      openshift-storage ocs-deviceset-0-data-1cv2lb Bound local-pv-5ab0734f 70Gi RWO local-block-ocs 38m
      openshift-storage ocs-deviceset-0-data-2rb2bj Bound local-pv-4b950316 70Gi RWO local-block-ocs 38m
      openshift-virtualization-os-images centos-stream8-b9b768dcd73b Bound pvc-2656c6b9-fafd-4ca5-bfd0-d6dd5a3cec5e 149Gi RWO hostpath-csi-basic 30m
      openshift-virtualization-os-images centos-stream9-49f10670e687 Bound pvc-e15c2615-ea72-4ff2-9da4-5251a25390da 149Gi RWO hostpath-csi-basic 30m
      openshift-virtualization-os-images centos7-680e9b4e0fba Bound pvc-fd6804cf-4bd6-496d-85c9-ec3976371cae 149Gi RWO hostpath-csi-basic 30m
      openshift-virtualization-os-images fedora-f7cc15256f08 Bound pvc-11529545-a22b-4f74-b17b-019fe34a8f53 149Gi RWO hostpath-csi-basic 30m
      openshift-virtualization-os-images prime-4f58de2b-e099-439f-9d99-d1ebe4dfedf7 Lost pvc-e15c2615-ea72-4ff2-9da4-5251a25390da 0 hostpath-csi-basic 30m
      openshift-virtualization-os-images prime-915f7304-1f52-4fa5-9eca-4fdaff8beba9 Lost pvc-fd6804cf-4bd6-496d-85c9-ec3976371cae 0 hostpath-csi-basic 30m
      openshift-virtualization-os-images prime-b3c897af-46da-4385-8a39-edec802e99d6 Lost pvc-c630f451-1d7c-41b7-a080-04a42d2de8c1 0 hostpath-csi-basic 30m
      openshift-virtualization-os-images rhel8-0da894200daa Bound pvc-eac206e9-6793-4bc1-bcdb-acd5ccaa6ffd 149Gi RWO hostpath-csi-basic 30m
      openshift-virtualization-os-images rhel9-b006ef7856b6 Bound pvc-c630f451-1d7c-41b7-a080-04a42d2de8c1 149Gi RWO hostpath-csi-basic 30m

      2. $ oc get dv -A
      NAMESPACE NAME PHASE PROGRESS RESTARTS AGE
      openshift-virtualization-os-images centos-stream8-b9b768dcd73b Succeeded 100.0% 30m
      openshift-virtualization-os-images centos-stream9-49f10670e687 Succeeded 100.0% 30m
      openshift-virtualization-os-images centos7-680e9b4e0fba Succeeded 100.0% 30m
      openshift-virtualization-os-images fedora-f7cc15256f08 Succeeded 100.0% 30m
      openshift-virtualization-os-images rhel8-0da894200daa Succeeded 100.0% 30m
      openshift-virtualization-os-images rhel9-b006ef7856b6 Succeeded 100.0% 30m

      Actual results:
      3 'Lost' prime PVCs
      openshift-virtualization-os-images prime-4f58de2b-e099-439f-9d99-d1ebe4dfedf7 Lost pvc-e15c2615-ea72-4ff2-9da4-5251a25390da 0 hostpath-csi-basic 30m
      openshift-virtualization-os-images prime-915f7304-1f52-4fa5-9eca-4fdaff8beba9 Lost pvc-fd6804cf-4bd6-496d-85c9-ec3976371cae 0 hostpath-csi-basic 30m
      openshift-virtualization-os-images prime-b3c897af-46da-4385-8a39-edec802e99d6 Lost pvc-c630f451-1d7c-41b7-a080-04a42d2de8c1 0 hostpath-csi-basic 30m

      Expected results:
      No prime PVCs

      Additional info:

      [cloud-user@ocp-psi-executor jenia]$ oc get pvc -n openshift-virtualization-os-images prime-4f58de2b-e099-439f-9d99-d1ebe4dfedf7 -oyaml
      apiVersion: v1
      kind: PersistentVolumeClaim
      metadata:
      annotations:
      cdi.kubevirt.io/storage.bind.immediate.requested: ""
      cdi.kubevirt.io/storage.condition.running: "false"
      cdi.kubevirt.io/storage.condition.running.message: Import Complete
      cdi.kubevirt.io/storage.condition.running.reason: Completed
      cdi.kubevirt.io/storage.contentType: kubevirt
      cdi.kubevirt.io/storage.import.endpoint: docker://quay.io/containerdisks/centos-stream@sha256:49f10670e687e20b29f0dbc30e23bb784942e58573cf4d62017dbeabca5eb02f
      cdi.kubevirt.io/storage.import.importPodName: importer-prime-4f58de2b-e099-439f-9d99-d1ebe4dfedf7
      cdi.kubevirt.io/storage.import.registryImportMethod: node
      cdi.kubevirt.io/storage.import.source: registry
      cdi.kubevirt.io/storage.pod.phase: Succeeded
      cdi.kubevirt.io/storage.pod.restarts: "0"
      cdi.kubevirt.io/storage.populator.kind: VolumeImportSource
      cdi.kubevirt.io/storage.preallocation.requested: "false"
      pv.kubernetes.io/bind-completed: "yes"
      pv.kubernetes.io/bound-by-controller: "yes"
      sidecar.istio.io/inject: "false"
      volume.beta.kubernetes.io/storage-provisioner: kubevirt.io.hostpath-provisioner
      volume.kubernetes.io/selected-node: c01-jp414-qfjfs-worker-0-f6qmc
      volume.kubernetes.io/storage-provisioner: kubevirt.io.hostpath-provisioner
      creationTimestamp: "2023-07-17T12:44:13Z"
      finalizers:

      • kubernetes.io/pvc-protection
        labels:
        app: containerized-data-importer
        app.kubernetes.io/component: storage
        app.kubernetes.io/managed-by: cdi-controller
        app.kubernetes.io/part-of: hyperconverged-cluster
        app.kubernetes.io/version: 4.14.0
        name: prime-4f58de2b-e099-439f-9d99-d1ebe4dfedf7
        namespace: openshift-virtualization-os-images
        ownerReferences:
      • apiVersion: v1
        blockOwnerDeletion: true
        controller: true
        kind: PersistentVolumeClaim
        name: centos-stream9-49f10670e687
        uid: 4f58de2b-e099-439f-9d99-d1ebe4dfedf7
        resourceVersion: "75947"
        uid: e15c2615-ea72-4ff2-9da4-5251a25390da
        spec:
        accessModes:
      • ReadWriteOnce
        resources:
        requests:
        storage: "34087042032"
        storageClassName: hostpath-csi-basic
        volumeMode: Filesystem
        volumeName: pvc-e15c2615-ea72-4ff2-9da4-5251a25390da
        status:
        phase: Lost

            rh-ee-alromero Alvaro Romero
            jpeimer@redhat.com Jenia Peimer
            Jenia Peimer Jenia Peimer
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: