Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-38811

CDI Tier1: SNO LVMS pvc leftover in Terminating state

XMLWordPrintable

    • No

      Description of problem:

      After CDI tier1 lane, I see there's a leftover PVC in Terminating state and a namespace

      Version-Release number of selected component (if applicable):

      4.15

      How reproducible:

      Seen twice on SNO LVMS, haven't checked on OCS or HPP lanes

      Steps to Reproduce:

      1. Run CDI tier1 lane
      

      Actual results:

      $ oc get dv -A
      No resources found
      
      $ oc get pvc -A
      NAMESPACE                                  NAME         STATUS        VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS   AGE
      cdi-e2e-tests-population-func-test-wv85h   test-dv      Terminating                                                                        lvms-vg1       36h
      

      PVC yaml:

      $ oc get pvc -n cdi-e2e-tests-population-func-test-wv85h  test-dv -oyaml
      apiVersion: v1
      kind: PersistentVolumeClaim
      metadata:
        annotations:
          cdi.kubevirt.io/externalPopulation: "true"
          cdi.kubevirt.io/storage.contentType: kubevirt
          cdi.kubevirt.io/storage.deleteAfterCompletion: "false"
          cdi.kubevirt.io/storage.pod.restarts: "0"
          cdi.kubevirt.io/storage.preallocation.requested: "false"
          cdi.kubevirt.io/storage.usePopulator: "true"
          volume.beta.kubernetes.io/storage-provisioner: topolvm.io
          volume.kubernetes.io/selected-node: cnv-qe-infra-23.cnvqe2.lab.eng.rdu2.redhat.com
          volume.kubernetes.io/storage-provisioner: topolvm.io
        creationTimestamp: "2024-02-26T21:41:45Z"
        deletionGracePeriodSeconds: 0
        deletionTimestamp: "2024-02-26T21:46:25Z"
        finalizers:
        - cdi.sample.populator/populate-target-protection
        labels:
          alerts.k8s.io/KubePersistentVolumeFillingUp: disabled
          app: containerized-data-importer
          app.kubernetes.io/component: storage
          app.kubernetes.io/managed-by: cdi-controller
          app.kubernetes.io/part-of: hyperconverged-cluster
          app.kubernetes.io/version: 4.15.0
        name: test-dv
        namespace: cdi-e2e-tests-population-func-test-wv85h
        ownerReferences:
        - apiVersion: cdi.kubevirt.io/v1beta1
          blockOwnerDeletion: true
          controller: true
          kind: DataVolume
          name: test-dv
          uid: 55ea691f-4104-407f-b3b5-727645022b81
        resourceVersion: "4200319"
        uid: 44a57dca-734e-4fdf-ba68-81e8cbdb97aa
      spec:
        accessModes:
        - ReadWriteOnce
        dataSource:
          apiGroup: cdi.sample.populator
          kind: SamplePopulator
          name: sample-populator
        dataSourceRef:
          apiGroup: cdi.sample.populator
          kind: SamplePopulator
          name: sample-populator
        resources:
          requests:
            storage: "110960424"
        storageClassName: lvms-vg1
        volumeMode: Filesystem
      status:
        phase: Pending
       

      PVC describe:

      $ oc describe pvc -n cdi-e2e-tests-population-func-test-wv85h  test-dv 
      Name:          test-dv
      Namespace:     cdi-e2e-tests-population-func-test-wv85h
      StorageClass:  lvms-vg1
      Status:        Terminating (lasts 36h)
      Volume:        
      Labels:        alerts.k8s.io/KubePersistentVolumeFillingUp=disabled
                     app=containerized-data-importer
                     app.kubernetes.io/component=storage
                     app.kubernetes.io/managed-by=cdi-controller
                     app.kubernetes.io/part-of=hyperconverged-cluster
                     app.kubernetes.io/version=4.15.0
      Annotations:   cdi.kubevirt.io/externalPopulation: true
                     cdi.kubevirt.io/storage.contentType: kubevirt
                     cdi.kubevirt.io/storage.deleteAfterCompletion: false
                     cdi.kubevirt.io/storage.pod.restarts: 0
                     cdi.kubevirt.io/storage.preallocation.requested: false
                     cdi.kubevirt.io/storage.usePopulator: true
                     volume.beta.kubernetes.io/storage-provisioner: topolvm.io
                     volume.kubernetes.io/selected-node: cnv-qe-infra-23.cnvqe2.lab.eng.rdu2.redhat.com
                     volume.kubernetes.io/storage-provisioner: topolvm.io
      Finalizers:    [cdi.sample.populator/populate-target-protection]
      Capacity:      
      Access Modes:  
      VolumeMode:    Filesystem
      DataSource:
        APIGroup:  cdi.sample.populator
        Kind:      SamplePopulator
        Name:      sample-populator
      Used By:     <none>
      Events:      <none>
       

      Namespace yaml:

      $ oc get project cdi-e2e-tests-population-func-test-wv85h -oyaml
      apiVersion: project.openshift.io/v1
      kind: Project
      metadata:
        annotations:
          openshift.io/sa.scc.mcs: s0:c61,c55
          openshift.io/sa.scc.supplemental-groups: 1003770000/10000
          openshift.io/sa.scc.uid-range: 1003770000/10000
        creationTimestamp: "2024-02-26T21:41:43Z"
        deletionTimestamp: "2024-02-26T21:46:20Z"
        generateName: cdi-e2e-tests-population-func-test-
        labels:
          cdi-e2e: population-func-test
          kubernetes.io/metadata.name: cdi-e2e-tests-population-func-test-wv85h
          openshift-pipelines.tekton.dev/namespace-reconcile-version: 1.13.1
          pod-security.kubernetes.io/enforce: restricted
          security.openshift.io/scc.podSecurityLabelSync: "false"
        name: cdi-e2e-tests-population-func-test-wv85h
        resourceVersion: "8015009"
        uid: 81232f38-c0cb-4ccc-97f6-18b6b5448ff3
      spec:
        finalizers:
        - kubernetes
      status:
        conditions:
        - lastTransitionTime: "2024-02-27T22:37:58Z"
          message: All resources successfully discovered
          reason: ResourcesDiscovered
          status: "False"
          type: NamespaceDeletionDiscoveryFailure
        - lastTransitionTime: "2024-02-26T21:46:26Z"
          message: All legacy kube types successfully parsed
          reason: ParsedGroupVersions
          status: "False"
          type: NamespaceDeletionGroupVersionParsingFailure
        - lastTransitionTime: "2024-02-26T21:46:26Z"
          message: All content successfully deleted, may be waiting on finalization
          reason: ContentDeleted
          status: "False"
          type: NamespaceDeletionContentFailure
        - lastTransitionTime: "2024-02-26T21:46:26Z"
          message: 'Some resources are remaining: persistentvolumeclaims. has 1 resource
            instances'
          reason: SomeResourcesRemain
          status: "True"
          type: NamespaceContentRemaining
        - lastTransitionTime: "2024-02-26T21:46:26Z"
          message: 'Some content in the namespace has finalizers remaining: cdi.sample.populator/populate-target-protection
            in 1 resource instances'
          reason: SomeFinalizersRemain
          status: "True"
          type: NamespaceFinalizersRemaining
        phase: Terminating

      Expected results:

      No leftovers

      Additional info:

       

              akalenyu Alex Kalenyuk
              jpeimer@redhat.com Jenia Peimer
              Jenia Peimer Jenia Peimer
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: