[2040377] Unable to delete failed VMIM after VM deleted

Description of problem:

Unable to delete failed VMIM after VM deleted

Version-Release number of selected component (if applicable):

Bundle
v4.10.0-551

How reproducible:

Intermittent.

Steps to Reproduce:
0. With descheduler installed:
1. Create VMs on nodes
2. Drain single node, causing evictions
3. Uncordon same node, causing descheduler evictions
4. Delete VMs

Actual results:

$ oc -n ssp-descheduler-test-descheduler delete vmim kubevirt-evacuation-p2wbc --timeout=60s
virtualmachineinstancemigration.kubevirt.io "kubevirt-evacuation-p2wbc" deleted
error: timed out waiting for the condition on virtualmachineinstancemigrations/kubevirt-evacuation-p2wbc

does not delete, hits timeout.

virt-controller error:

{"component":"virt-controller","kind":"","level":"error","msg":"Updating the VirtualMachine status failed.","name":"vm-1-1642014474-2693942","namespace":"ssp-descheduler-test-descheduler","pos":"vm.go:311","reason":"Operation cannot be fulfilled on virtualmachines.

{"component":"virt-controller","kind":"","level":"error","msg":"Unable to migrate vmi because vmi is shutdown.","name":"kubevirt-evacuation-p2wbc","namespace":"ssp-descheduler-test-descheduler","pos":"migration.go:394","timestamp":"2022-01-12T19:24:28.323305Z","uid":"154d9a41-5338-44e7-8445-cc66fc18852d"}

Expected results:

VMIM deleted

Additional info:

Failed VMIM:

apiVersion: kubevirt.io/v1
kind: VirtualMachineInstanceMigration
metadata:
annotations:
kubevirt.io/evacuationMigration: c01-sb410a-5zp8b-worker-0-c85cq
kubevirt.io/latest-observed-api-version: v1
kubevirt.io/storage-observed-api-version: v1alpha3
creationTimestamp: "2022-01-12T19:24:22Z"
deletionGracePeriodSeconds: 0
deletionTimestamp: "2022-01-12T19:24:31Z"
finalizers:

• kubevirt.io/migrationJobFinalize
  generateName: kubevirt-evacuation-
  generation: 2
  labels:
  kubevirt.io/vmi-name: vm-3-1642014475-2945707
  name: kubevirt-evacuation-p2wbc
  namespace: ssp-descheduler-test-descheduler
  resourceVersion: "11431506"
  uid: 154d9a41-5338-44e7-8445-cc66fc18852d
  spec:
  vmiName: vm-3-1642014475-2945707
  status:
  phase: Failed