Uploaded image for project: 'OpenShift Virtualization'
  1. OpenShift Virtualization
  2. CNV-29318

[2211596] Images that require too much space actually get imported potentially overwhelming disk

XMLWordPrintable

    • Storage Core Sprint 246
    • High
    • No

      Description of problem:
      CDI imports images of a much larger size than requested, causing DiskPressure on the node.

      [test_id:2329] fails from time to time with evicted importer pods complaining about DiskPressure:
      https://search.ci.kubevirt.io/?search=too+much+space&maxAge=336h&context=1&type=bug%2Bissue%2Bjunit&name=&excludeName=&maxMatches=5&maxBytes=20971520&groupBy=job

      Version-Release number of selected component (if applicable):
      4.14

      How reproducible:
      From time to time

      Steps to Reproduce:
      1. Create a DV requesting a much smaller size than the image size

      Actual results:
      From time to time DV gets created

      Expected results:
      Reject such images early on

      Additional info:

      Importer pod log:

      I0516 17:00:57.575666 1 importer.go:103] Starting importer
      I0516 17:00:57.575728 1 importer.go:172] begin import process
      I0516 17:00:57.575808 1 http-datasource.go:392] Attempting to HEAD "http://cdi-file-host.cdi/cirros-large-virtual-size.raw.xz" via http client
      I0516 17:00:57.580394 1 http-datasource.go:404] GO CLIENT: key: Server, value: [nginx/1.20.1]
      I0516 17:00:57.580430 1 http-datasource.go:404] GO CLIENT: key: Date, value: [Tue, 16 May 2023 17:00:57 GMT]
      I0516 17:00:57.580442 1 http-datasource.go:404] GO CLIENT: key: Content-Type, value: [text/plain]
      I0516 17:00:57.580452 1 http-datasource.go:404] GO CLIENT: key: Connection, value: [keep-alive]
      I0516 17:00:57.580463 1 http-datasource.go:404] GO CLIENT: key: Content-Length, value: [12340872]
      I0516 17:00:57.580473 1 http-datasource.go:404] GO CLIENT: key: Last-Modified, value: [Tue, 16 May 2023 10:38:31 GMT]
      I0516 17:00:57.580483 1 http-datasource.go:404] GO CLIENT: key: Etag, value: ["64635d27-bc4e88"]
      I0516 17:00:57.580508 1 http-datasource.go:404] GO CLIENT: key: Accept-Ranges, value: [bytes]
      I0516 17:00:57.580524 1 http-datasource.go:424] Content length: 12340872
      I0516 17:00:57.580558 1 http-datasource.go:327] Attempting to get object "http://cdi-file-host.cdi/cirros-large-virtual-size.raw.xz" via http client
      I0516 17:00:57.603283 1 data-processor.go:356] Calculating available size
      I0516 17:00:57.603407 1 data-processor.go:368] Checking out file system volume size.
      I0516 17:00:57.603444 1 data-processor.go:376] Request image size not empty.
      I0516 17:00:57.603498 1 data-processor.go:381] Target size 492768256.
      I0516 17:00:57.603573 1 format-readers.go:112] constructReaders: checking compression and archive formats
      I0516 17:00:57.603622 1 format-readers.go:121] found header of type "xz"
      I0516 17:00:57.646847 1 data-processor.go:255] New phase: TransferDataFile
      I0516 17:00:57.647003 1 util.go:194] Writing data...
      I0516 17:00:58.647782 1 prometheus.go:75] 73.66
      I0516 17:00:59.648428 1 prometheus.go:75] 97.64
      I0516 17:01:00.648879 1 prometheus.go:75] 97.76
      I0516 17:01:01.649697 1 prometheus.go:75] 97.91
      E0516 17:01:02.508903 1 util.go:196] Unable to write file from dataReader: write /data/disk.img: no space left on device
      E0516 17:01:02.635696 1 data-processor.go:251] write /data/disk.img: no space left on device

              rhn-support-awels Alexander Wels
              jpeimer@redhat.com Jenia Peimer
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

                Created:
                Updated:
                Resolved: