Loading...

Type: Bug
Resolution: Unresolved
Priority: Critical
Fix Version/s: None
Affects Version/s: 2.11.0
Component/s: Controller
Labels:
- Scale&Perf-QE
- vmware

Activity Type:
Quality / Stability / Reliability
Blocked:
False
Blocked Reason:

Hide

None

Show
None
Ready:
True
Intelligence Requested:
Market:

Severity:
Critical

SFDC Cases Links:
SFDC Cases Open:
SFDC Cases Counter:

PX Impact Score:

Storage-offload warm migration fails during the importer pod phase with the error “Could not find current snapshot”.

Scenario:
Warm migration using storage offloading 1TB warm cycle .
OCP : 4.20.8
MTV: 2-11-0-30
CNV: 4.20.3
VMware: 7.0.3

Flow status:

Inspection / conversion step – completed successfully

Populate pod (xcopy) – completed successfully

Importer pod – failed

Failure details:
The importer pod fails on startup with the following error:

Defaulted container "importer" out of: importer, vddk-side-car (init)

Relevant logs:

 [kni@f01-h07-000-r640 Tzahi_MTV]$ oc logs importer-1vm-1tb-disk-0-918d7624-checkpoint-2841-snapshot-6 \
> -c importer \
> --previous \
> -n 1vm-1tb-offload-warm-tc4-1
I0119 14:39:47.042450       1 importer.go:107] Starting importer
I0119 14:39:47.043460       1 importer.go:182] begin import process
I0119 14:39:47.043493       1 vddk-datasource_amd64.go:838] Creating VDDK data source: backingFile [[PerfTest_VC7_1_ISCSI_24TB] 1tb-75-usage1/1tb-75-usage1_3.vmdk], currentCheckpoint [2841-snapshot-6], previousCheckpoint [52 7e 9b 8c 4e 6a dd ba-e4 a3 b8 e1 41 3f 63 9c/72], finalCheckpoint [true]
I0119 14:39:47.087364       1 vddk-datasource_amd64.go:497] VM 4235d45d-9c73-383c-10d2-b3e6a1a46aaa found in datacenter Datacenter:datacenter-3 @ /Perf: vm-35364
I0119 14:39:47.089337       1 vddk-datasource_amd64.go:298] Current VM power state: poweredOff
E0119 14:39:47.096952       1 vddk-datasource_amd64.go:864] Could not find current snapshot 2841-snapshot-6: snapshot "2841-snapshot-6" not found
E0119 14:39:47.096967       1 importer.go:348] snapshot "2841-snapshot-6" not found

pods

[kni@f01-h07-000-r640 Tzahi_MTV]$ oc get pods -n 1vm-1tb-offload-warm-tc4-1
NAME                                                            READY   STATUS             RESTARTS        AGE
1vm-1tb-offload-warm-tc4-1-vm-35364-inspection-9pb22            0/1     Completed          0               72m
1vm-1tb-offload-warm-tc4-1-vm-35364-pvcinit-8rgff               0/1     Completed          0               69m
importer-1vm--1tb--disk-0-918d7624-checkpoint-2841-snapshot-6   0/1     CrashLoopBackOff   10 (2m8s ago)   28m
populate-88e5561e-2999-4fe7-8faa-5dbd373cf79e                   0/1     Completed          0               69m
vddk-validator-1vm-1tb-offload-warm-tc4-1rjm5d-bmzb2            0/1     Completed          0               73m

DV:

apiVersion: v1
items:
- apiVersion: cdi.kubevirt.io/v1beta1
  kind: DataVolume
  metadata:
    annotations:
      cdi.kubevirt.io/allowClaimAdoption: "false"
      cdi.kubevirt.io/storage.bind.immediate.requested: "true"
      cdi.kubevirt.io/storage.deleteAfterCompletion: "false"
      cdi.kubevirt.io/storage.prePopulated: "true"
      cdi.kubevirt.io/storage.usePopulator: "true"
      forklift.konveyor.io/disk-index: "0"
      forklift.konveyor.io/disk-source: '[PerfTest_VC7_1_ISCSI_24TB] 1tb-75-usage1/1tb-75-usage1_3.vmdk'
      migration: 1fa8c4bc-b0b9-410e-ad32-5535e17d839e
      plan: e0aa3a99-b1a2-4e9f-a86d-e9c749814cd6
      resource: vm-config
      vmID: vm-35364
    creationTimestamp: "2026-01-19T13:32:06Z"
    generation: 2
    labels:
      migration: 1fa8c4bc-b0b9-410e-ad32-5535e17d839e
      plan: e0aa3a99-b1a2-4e9f-a86d-e9c749814cd6
      resource: vm-config
      vmID: vm-35364
    name: 1vm--1tb--disk-0-918d7624
    namespace: 1vm-1tb-offload-warm-tc4-1
    resourceVersion: "1487964327"
    uid: 5d02c32e-7e0c-4edb-aa0b-8b2ec090016b
  spec:
    checkpoints:
    - current: 2841-snapshot-5
      previous: ""
    - current: 2841-snapshot-6
      previous: 52 7e 9b 8c 4e 6a dd ba-e4 a3 b8 e1 41 3f 63 9c/72
    finalCheckpoint: true
    source:
      vddk:
        backingFile: '[PerfTest_VC7_1_ISCSI_24TB] 1tb-75-usage1/1tb-75-usage1_3.vmdk'
        initImageURL: quay.io/qiyuan1/test7
        secretRef: 1vm-1tb-offload-warm-tc4-1-vm-35364-hjgzz
        thumbprint: D9:7B:E4:D7:67:06:25:11:E5:C4:FB:E2:48:1C:4A:8A:04:58:11:68
        url: https://172.16.12.12/sdk
        uuid: 4235d45d-9c73-383c-10d2-b3e6a1a46aaa
    storage:
      accessModes:
      - ReadWriteMany
      resources:
        requests:
          storage: 1Ti
      storageClassName: netapp-ontap-perf-iscsi
  status:
    claimName: 1vm--1tb--disk-0-918d7624
    conditions:
    - lastHeartbeatTime: "2026-01-19T14:13:04Z"
      lastTransitionTime: "2026-01-19T14:13:04Z"
      message: PVC 1vm--1tb--disk-0-918d7624 Bound
      reason: Bound
      status: "True"
      type: Bound
    - lastHeartbeatTime: "2026-01-19T14:34:44Z"
      lastTransitionTime: "2026-01-19T13:32:09Z"
      status: "False"
      type: Ready
    - lastHeartbeatTime: "2026-01-19T14:34:44Z"
      lastTransitionTime: "2026-01-19T14:34:44Z"
      message: 'Unable to connect to vddk data source: snapshot "2841-snapshot-6"
        not found'
      reason: Error
      status: "False"
      type: Running
    phase: ImportInProgress
    progress: N/A
    restartCount: 9
kind: List
metadata:
  resourceVersion: ""

Impact:
Warm migration using storage offloading cannot complete due to importer pod failure caused by missing snapshot detection.

full logs can be found under this path on the following provisioner of cloud15 :

f01-h07-000-r640.rdu2.scalelab.redhat.com:/home/kni/Tzahi_MTV/mtv-debug-1vm-1tb-offload-warm-tc4-1-20260119-143609

Details

Description

Attachments

Easy Agile Planning Poker

Activity

People

Dates