Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-45479

Race during populator rebind causing extra pvc' to be left behind

    • Icon: Bug Bug
    • Resolution: Done-Errata
    • Icon: Normal Normal
    • CNV v4.17.0
    • None
    • Storage Platform
    • None
    • 1
    • False
    • Hide

      None

      Show
      None
    • False
    • CNV v4.99.0.rhel9-1091
    • ---
    • ---
    • Storage Core Sprint 257, Storage Core Sprint 258, Storage Core Sprint 259, CNV Storage 260
    • None

      Description of problem:
      There is a test flake example where population completes successfully but pvc' is left behind. mhenriks@redhat.com surmises that the problem is the controller does not wait for rebind before deleting pvc' and the result is that pvc' gets recreated.

      Upload tests Upload population standard should succeed given a valid token (form async)

            [CNV-45479] Race during populator rebind causing extra pvc' to be left behind

            Errata Tool added a comment -

            Since the problem described in this issue should be resolved in a recent advisory, it has been closed.

            For information on the advisory (OpenShift Virtualization 4.17.0 Images), and where to find the updated files, follow the link below.

            If the solution does not work for you, open a new bug report.
            https://access.redhat.com/errata/RHEA-2024:8140

            Errata Tool added a comment - Since the problem described in this issue should be resolved in a recent advisory, it has been closed. For information on the advisory (OpenShift Virtualization 4.17.0 Images), and where to find the updated files, follow the link below. If the solution does not work for you, open a new bug report. https://access.redhat.com/errata/RHEA-2024:8140

            Verified on CNV-v4.17.0.rhel9-803

            Uploaded 10 DVs - don't see any prime PVCs left behind.

            $ virtctl image-upload dv cirros-dv-ocs-10 --image-path=./cirros-0.4.0-x86_64-disk.qcow2  --size=1Gi --storage-class=ocs-storagecluster-ceph-rbd-virtualization --insecure
            $ oc get dv
            NAME               PHASE       PROGRESS   RESTARTS   AGE
            cirros-dv-ocs      Succeeded   N/A                   9m46s
            cirros-dv-ocs-10   Succeeded   N/A                   39s
            cirros-dv-ocs-2    Succeeded   N/A                   8m50s
            cirros-dv-ocs-3    Succeeded   N/A                   7m55s
            cirros-dv-ocs-4    Succeeded   N/A                   7m1s
            cirros-dv-ocs-5    Succeeded   N/A                   6m22s
            cirros-dv-ocs-6    Succeeded   N/A                   2m29s
            cirros-dv-ocs-7    Succeeded   N/A                   2m8s
            cirros-dv-ocs-8    Succeeded   N/A                   106s
            cirros-dv-ocs-9    Succeeded   N/A                   80s
            
            $ oc get pvc 
            NAME               STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                                 VOLUMEATTRIBUTESCLASS   AGE
            cirros-dv-ocs      Bound    pvc-5fda9109-469a-4582-9293-60489d68b02f   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 9m48s
            cirros-dv-ocs-10   Bound    pvc-9663559a-d63f-4961-8772-a865f1bf42a7   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 41s
            cirros-dv-ocs-2    Bound    pvc-ef8b0611-16a7-4416-abc5-6c2ccf05acca   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 8m52s
            cirros-dv-ocs-3    Bound    pvc-2da1e5ee-59b2-40c2-b643-9969ebd1f04d   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 7m57s
            cirros-dv-ocs-4    Bound    pvc-24734f13-4c2c-49eb-8585-eff92a89adc5   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 7m3s
            cirros-dv-ocs-5    Bound    pvc-530373e7-35d7-489e-90dd-14e8f320e062   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 6m24s
            cirros-dv-ocs-6    Bound    pvc-8e343e04-2b65-4443-8036-21957b2945ea   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 2m31s
            cirros-dv-ocs-7    Bound    pvc-fb61137a-9c8e-498d-9b99-94c1e49ba670   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 2m10s
            cirros-dv-ocs-8    Bound    pvc-3d2d9acf-3c63-4b2d-8dbb-b79e57dff9ed   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 108s
            cirros-dv-ocs-9    Bound    pvc-f28948de-9117-4334-a267-102a2d2bbf0b   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 82s

            Jenia Peimer added a comment - Verified on CNV-v4.17.0.rhel9-803 Uploaded 10 DVs - don't see any prime PVCs left behind. $ virtctl image-upload dv cirros-dv-ocs-10 --image-path=./cirros-0.4.0-x86_64-disk.qcow2  --size=1Gi --storage-class=ocs-storagecluster-ceph-rbd-virtualization --insecure $ oc get dv NAME               PHASE       PROGRESS   RESTARTS   AGE cirros-dv-ocs      Succeeded   N/A                   9m46s cirros-dv-ocs-10   Succeeded   N/A                   39s cirros-dv-ocs-2    Succeeded   N/A                   8m50s cirros-dv-ocs-3    Succeeded   N/A                   7m55s cirros-dv-ocs-4    Succeeded   N/A                   7m1s cirros-dv-ocs-5    Succeeded   N/A                   6m22s cirros-dv-ocs-6    Succeeded   N/A                   2m29s cirros-dv-ocs-7    Succeeded   N/A                   2m8s cirros-dv-ocs-8    Succeeded   N/A                   106s cirros-dv-ocs-9    Succeeded   N/A                   80s $ oc get pvc NAME               STATUS   VOLUME                                     CAPACITY   ACCESS MODES   STORAGECLASS                                 VOLUMEATTRIBUTESCLASS   AGE cirros-dv-ocs      Bound    pvc-5fda9109-469a-4582-9293-60489d68b02f   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 9m48s cirros-dv-ocs-10   Bound    pvc-9663559a-d63f-4961-8772-a865f1bf42a7   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 41s cirros-dv-ocs-2    Bound    pvc-ef8b0611-16a7-4416-abc5-6c2ccf05acca   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 8m52s cirros-dv-ocs-3    Bound    pvc-2da1e5ee-59b2-40c2-b643-9969ebd1f04d   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 7m57s cirros-dv-ocs-4    Bound    pvc-24734f13-4c2c-49eb-8585-eff92a89adc5   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 7m3s cirros-dv-ocs-5    Bound    pvc-530373e7-35d7-489e-90dd-14e8f320e062   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 6m24s cirros-dv-ocs-6    Bound    pvc-8e343e04-2b65-4443-8036-21957b2945ea   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 2m31s cirros-dv-ocs-7    Bound    pvc-fb61137a-9c8e-498d-9b99-94c1e49ba670   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 2m10s cirros-dv-ocs-8    Bound    pvc-3d2d9acf-3c63-4b2d-8dbb-b79e57dff9ed   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 108s cirros-dv-ocs-9    Bound    pvc-f28948de-9117-4334-a267-102a2d2bbf0b   1Gi        RWX            ocs-storagecluster-ceph-rbd-virtualization   <unset>                 82s

            cnv-qe jira added a comment -

            The first build that contains https://github.com/kubevirt/containerized-data-importer/pull/3362 is CNV v4.99.0.rhel9-1091.
            Not moving to ON_QA, because the fix is available only on a sprintly build.

            cnv-qe jira added a comment - The first build that contains https://github.com/kubevirt/containerized-data-importer/pull/3362 is CNV v4.99.0.rhel9-1091 . Not moving to ON_QA, because the fix is available only on a sprintly build.

            cnv-qe jira added a comment -

            All linked PR(s) of this bug have been merged, moving status from POST to MODIFIED.
            https://github.com/kubevirt/containerized-data-importer/pull/3362 merged at 2024-08-22 20:22:35

            cnv-qe jira added a comment - All linked PR(s) of this bug have been merged, moving status from POST to MODIFIED. https://github.com/kubevirt/containerized-data-importer/pull/3362 merged at 2024-08-22 20:22:35

            CPaaS Service Account mentioned this issue in merge request !1526 of cpaas-midstream / openshift-virtualization / containerized-data-importer on branch cnv-4.99-rhel-9_upstream_dc16979a6135085cfe1efcd09f32aebf:

            Updated US source to: 4c911fe Fix PVC deletion logic in populators (#3362)

            GitLab CEE Bot added a comment - CPaaS Service Account mentioned this issue in merge request !1526 of cpaas-midstream / openshift-virtualization / containerized-data-importer on branch cnv-4.99-rhel-9_ upstream _dc16979a6135085cfe1efcd09f32aebf : Updated US source to: 4c911fe Fix PVC deletion logic in populators (#3362)

            cnv-qe jira added a comment -

            This bug has a linked PR, moving status from ASSIGNED to POST.

            cnv-qe jira added a comment - This bug has a linked PR, moving status from ASSIGNED to POST.

              rh-ee-alromero Alvaro Romero
              alitke@redhat.com Adam Litke
              Jenia Peimer Jenia Peimer
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: