Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-75698

[GCP] Unable to resize PVC while its attached (online resize)

XMLWordPrintable

    • Product / Portfolio Work
    • 1
    • False
    • Hide

      None

      Show
      None
    • False
    • None
    • CNV Storage Sprint 281, CNV Storage Sprint 282
    • None

      Description of problem:

      in gcp (sp-balanced-storage) , we are not able to resize attached pvc
      from PVC:

        Warning  VolumeResizeFailed          89s (x2 over 89s)   external-resizer pd.csi.storage.gke.io                                                                        resize volume "pvc-96ac14d9-d090-4565-963b-2bddae53fb33" by resizer "pd.csi.storage.gke.io" failed: rpc error: code = InvalidArgument desc = ControllerExpandVolume failed to resize disk: failed to resize zonal volume Key{"pvc-96ac14d9-d090-4565-963b-2bddae53fb33", zone: "us-central1-c"}: googleapi: Error 400: Size of disks of type hyperdisk-balanced in READ_WRITE_MANY mode cannot be updated when they are attached., badRequest
      

      Version-Release number of selected component (if applicable):

      cnv-4.20 & cnv4.21

      How reproducible:

      100%

      Steps to Reproduce:

      1.craete a vm from pvc (majke sure pvc is bound and vm run)
      2.resize the pvc 
      for example I used oc patch: and the pvc size was 30Gi and I tried to increase it up to 31Gi
      ( oc patch pvc fedora-yellow-crab-48 -p '{"spec": {"resources": {"requests": {"storage": "31Gi"}}}}' -n default
      
       3.check if pvc got resized 
      

      Actual results:
      from pvc describe - the pvc did not get resized

       Type                    Status  LastProbeTime                     LastTransitionTime                Reason  Message
        ----                    ------  -----------------                 ------------------                ------  -------
        Resizing                True    Mon, 01 Jan 0001 00:00:00 +0000   Wed, 24 Dec 2025 10:03:17 -0500           
        ControllerResizeError   True    Mon, 01 Jan 0001 00:00:00 +0000   Wed, 24 Dec 2025 10:03:17 -0500           failed to expand pvc with rpc error: code = InvalidArgument desc = ControllerExpandVolume failed to resize disk: failed to resize zonal volume Key{"pvc-96ac14d9-d090-4565-963b-2bddae53fb33", zone: "us-central1-c"}: googleapi: Error 400: Size of disks of type hyperdisk-balanced in READ_WRITE_MANY mode cannot be updated when they are attached., badRequest
      Events:
        Type     Reason                      Age                 From                                                                                                          Message
        ----     ------                      ----                ----                                                                                                          -------
        Normal   WaitForFirstConsumer        20m (x3 over 20m)   persistentvolume-controller                                                                                   waiting for first consumer to be created before binding
        Warning  ProvisioningFailed          20m                 persistentvolume-controller                                                                                   Error saving claim: Operation cannot be fulfilled on persistentvolumeclaims "fedora-yellow-crab-48": the object has been modified; please apply your changes to the latest version and try again
        Normal   Provisioning                20m                 pd.csi.storage.gke.io_test-gcp3-s5z44-master-2.c.ocpstrat-1278.internal_b08bed1e-9b58-495f-a29f-eea6b7dc314e  External provisioner is provisioning volume for claim "default/fedora-yellow-crab-48"
        Normal   Provisioning                20m                 external-provisioner                                                                                          Assuming an external populator will provision the volume
        Normal   ExternalProvisioning        20m (x3 over 20m)   persistentvolume-controller                                                                                   Waiting for a volume to be created either by the external provisioner 'pd.csi.storage.gke.io' or manually by the system administrator. If volume creation is delayed, please verify that the provisioner is running and correctly registered.
        Normal   ExternalExpanding           90s                 volume_expand                                                                                                 waiting for an external controller to expand this PVC
        Warning  UnrecognizedDataSourceKind  89s (x16 over 20m)  volume-data-source-validator                                                                                  The datasource for this PVC does not match any registered VolumePopulator
        Normal   Resizing                    89s (x2 over 90s)   external-resizer pd.csi.storage.gke.io                                                                        External resizer is resizing volume pvc-96ac14d9-d090-4565-963b-2bddae53fb33
        Warning  VolumeResizeFailed          89s (x2 over 89s)   external-resizer pd.csi.storage.gke.io                                                                        resize volume "pvc-96ac14d9-d090-4565-963b-2bddae53fb33" by resizer "pd.csi.storage.gke.io" failed: rpc error: code = InvalidArgument desc = ControllerExpandVolume failed to resize disk: failed to resize zonal volume Key{"pvc-96ac14d9-d090-4565-963b-2bddae53fb33", zone: "us-central1-c"}: googleapi: Error 400: Size of disks of type hyperdisk-balanced in READ_WRITE_MANY mode cannot be updated when they are attached., badRequest
      

      Expected results:

      pvc size need to be resized, in ocs (ocs-storagecluster-ceph-rbd-virtualization)  the pvc successfully resized without any problem 
      
      9457-12b1-48c5-bc7e-47dfcfba1581
        Normal   ExternalExpanding           39m                volume_expand                                                                                                                           waiting for an external controller to expand this PVC
        Normal   Resizing                    39m                external-resizer openshift-storage.rbd.csi.ceph.com                                                                                     External resizer is resizing volume pvc-6b559457-12b1-48c5-bc7e-47dfcfba1581
        Normal   VolumeResizeSuccessful      39m                external-resizer openshift-storage.rbd.csi.ceph.com                                                                                     Resize volume succeeded
        Normal   FileSystemResizeSuccessful  39m                kubelet                                                                                                                                 MountVolume.NodeExpandVolume succeeded for volume "pvc-6b559457-12b1-48c5-bc7e-47dfcfba1581" c01-ahmad421-84k96-worker-0-864nn
      

      Additional info:

      impacted T2 test failing because if this
      tests.storage.online_resize.test_online_resize

              rh-ee-nassouli Noam Assouline
              rh-ee-ahafe Ahmad Hafi
              Natalie Gavrielov Natalie Gavrielov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated: