-
Bug
-
Resolution: Unresolved
-
Normal
-
CNV v4.15.0
Description of problem:
After CDI tier1 lane, I see there's a leftover PVC in Terminating state and a namespace
Version-Release number of selected component (if applicable):
4.15
How reproducible:
Seen twice on SNO LVMS, haven't checked on OCS or HPP lanes
Steps to Reproduce:
1. Run CDI tier1 lane
Actual results:
$ oc get dv -A No resources found $ oc get pvc -A NAMESPACE NAME STATUS VOLUME CAPACITY ACCESS MODES STORAGECLASS AGE cdi-e2e-tests-population-func-test-wv85h test-dv Terminating lvms-vg1 36h
PVC yaml:
$ oc get pvc -n cdi-e2e-tests-population-func-test-wv85h test-dv -oyaml apiVersion: v1 kind: PersistentVolumeClaim metadata: annotations: cdi.kubevirt.io/externalPopulation: "true" cdi.kubevirt.io/storage.contentType: kubevirt cdi.kubevirt.io/storage.deleteAfterCompletion: "false" cdi.kubevirt.io/storage.pod.restarts: "0" cdi.kubevirt.io/storage.preallocation.requested: "false" cdi.kubevirt.io/storage.usePopulator: "true" volume.beta.kubernetes.io/storage-provisioner: topolvm.io volume.kubernetes.io/selected-node: cnv-qe-infra-23.cnvqe2.lab.eng.rdu2.redhat.com volume.kubernetes.io/storage-provisioner: topolvm.io creationTimestamp: "2024-02-26T21:41:45Z" deletionGracePeriodSeconds: 0 deletionTimestamp: "2024-02-26T21:46:25Z" finalizers: - cdi.sample.populator/populate-target-protection labels: alerts.k8s.io/KubePersistentVolumeFillingUp: disabled app: containerized-data-importer app.kubernetes.io/component: storage app.kubernetes.io/managed-by: cdi-controller app.kubernetes.io/part-of: hyperconverged-cluster app.kubernetes.io/version: 4.15.0 name: test-dv namespace: cdi-e2e-tests-population-func-test-wv85h ownerReferences: - apiVersion: cdi.kubevirt.io/v1beta1 blockOwnerDeletion: true controller: true kind: DataVolume name: test-dv uid: 55ea691f-4104-407f-b3b5-727645022b81 resourceVersion: "4200319" uid: 44a57dca-734e-4fdf-ba68-81e8cbdb97aa spec: accessModes: - ReadWriteOnce dataSource: apiGroup: cdi.sample.populator kind: SamplePopulator name: sample-populator dataSourceRef: apiGroup: cdi.sample.populator kind: SamplePopulator name: sample-populator resources: requests: storage: "110960424" storageClassName: lvms-vg1 volumeMode: Filesystem status: phase: Pending
PVC describe:
$ oc describe pvc -n cdi-e2e-tests-population-func-test-wv85h test-dv Name: test-dv Namespace: cdi-e2e-tests-population-func-test-wv85h StorageClass: lvms-vg1 Status: Terminating (lasts 36h) Volume: Labels: alerts.k8s.io/KubePersistentVolumeFillingUp=disabled app=containerized-data-importer app.kubernetes.io/component=storage app.kubernetes.io/managed-by=cdi-controller app.kubernetes.io/part-of=hyperconverged-cluster app.kubernetes.io/version=4.15.0 Annotations: cdi.kubevirt.io/externalPopulation: true cdi.kubevirt.io/storage.contentType: kubevirt cdi.kubevirt.io/storage.deleteAfterCompletion: false cdi.kubevirt.io/storage.pod.restarts: 0 cdi.kubevirt.io/storage.preallocation.requested: false cdi.kubevirt.io/storage.usePopulator: true volume.beta.kubernetes.io/storage-provisioner: topolvm.io volume.kubernetes.io/selected-node: cnv-qe-infra-23.cnvqe2.lab.eng.rdu2.redhat.com volume.kubernetes.io/storage-provisioner: topolvm.io Finalizers: [cdi.sample.populator/populate-target-protection] Capacity: Access Modes: VolumeMode: Filesystem DataSource: APIGroup: cdi.sample.populator Kind: SamplePopulator Name: sample-populator Used By: <none> Events: <none>
Namespace yaml:
$ oc get project cdi-e2e-tests-population-func-test-wv85h -oyaml apiVersion: project.openshift.io/v1 kind: Project metadata: annotations: openshift.io/sa.scc.mcs: s0:c61,c55 openshift.io/sa.scc.supplemental-groups: 1003770000/10000 openshift.io/sa.scc.uid-range: 1003770000/10000 creationTimestamp: "2024-02-26T21:41:43Z" deletionTimestamp: "2024-02-26T21:46:20Z" generateName: cdi-e2e-tests-population-func-test- labels: cdi-e2e: population-func-test kubernetes.io/metadata.name: cdi-e2e-tests-population-func-test-wv85h openshift-pipelines.tekton.dev/namespace-reconcile-version: 1.13.1 pod-security.kubernetes.io/enforce: restricted security.openshift.io/scc.podSecurityLabelSync: "false" name: cdi-e2e-tests-population-func-test-wv85h resourceVersion: "8015009" uid: 81232f38-c0cb-4ccc-97f6-18b6b5448ff3 spec: finalizers: - kubernetes status: conditions: - lastTransitionTime: "2024-02-27T22:37:58Z" message: All resources successfully discovered reason: ResourcesDiscovered status: "False" type: NamespaceDeletionDiscoveryFailure - lastTransitionTime: "2024-02-26T21:46:26Z" message: All legacy kube types successfully parsed reason: ParsedGroupVersions status: "False" type: NamespaceDeletionGroupVersionParsingFailure - lastTransitionTime: "2024-02-26T21:46:26Z" message: All content successfully deleted, may be waiting on finalization reason: ContentDeleted status: "False" type: NamespaceDeletionContentFailure - lastTransitionTime: "2024-02-26T21:46:26Z" message: 'Some resources are remaining: persistentvolumeclaims. has 1 resource instances' reason: SomeResourcesRemain status: "True" type: NamespaceContentRemaining - lastTransitionTime: "2024-02-26T21:46:26Z" message: 'Some content in the namespace has finalizers remaining: cdi.sample.populator/populate-target-protection in 1 resource instances' reason: SomeFinalizersRemain status: "True" type: NamespaceFinalizersRemaining phase: Terminating
Expected results:
No leftovers
Additional info: