Uploaded image for project: 'Migration Toolkit for Virtualization'
  1. Migration Toolkit for Virtualization
  2. MTV-2908

Copyoffload migration fails due to vib issue on esxi

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Undefined Undefined
    • None
    • 2.9.0
    • None
    • Quality / Stability / Reliability
    • False
    • Hide

      None

      Show
      None
    • False

      Description of problem:

       

      Version-Release number of selected component (if applicable):

      2.9.0 

      How reproducible:

      Always / N%
      

      Steps to Reproduce:

      1. Try to migrate a shutdown VM, netapp iscsi datastore/vmdk
      2. Start the migration it fails on Disk-allocation phase
      3. Esxi ending with .129 the vib is installed, I don't know if it attempted to update it, the date is 2025-07-09 which is today. 
      
      
      

      Actual results:

      Migration fails, populator (populate-b202256a-0e40-435c-a060-714f8dd3f2e8 )pod log:
      
      I0709 09:29:33.774471 1 remote_esxcli.go:122] Storage Adapter UID: iqn.1998-01.com.vmware:ecoesxi01.lab.eng.tlv2.redhat.com:1372737626:64 (Driver: iscsi_vmk)
      I0709 09:29:34.059607 1 ontap.go:85] found lun /vol/trident_pvc_bb81c3fd_be73_47fc_9b00_385a5ec1c760/lun0 with serial 819TI$X101vJ
      I0709 09:29:34.119470 1 remote_esxcli.go:142] Current initiator groups the LUN is mapped to [00-50-56-8b-3f-c4-90df7438-5197-4aa8-a64f-162a1212224d]
      I0709 09:29:34.368529 1 remote_esxcli.go:158] resolved lun with IQN to lun /vmfs/devices/disks/naa.600a098038313954492458313031764a
      I0709 09:29:34.377716 1 client.go:54] about to run esxcli command [storage core device list -d naa.600a098038313954492458313031764a]
      I0709 09:29:34.423362 1 client.go:67] esxcli result message [], status []
      I0709 09:29:34.423419 1 remote_esxcli.go:164] found device naa.600a098038313954492458313031764a
      I0709 09:29:34.433191 1 client.go:54] about to run esxcli command [vmkfstools clone -s /vmfs/volumes/eco-iscsi-ds3/tshefi-linux9/tshefi-linux9.vmdk -t /vmfs/devices/disks/naa.600a098038313954492458313031764a]
      CLI Fault: EsxCLI.CLIFault.summary <obj xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="urn:vim25" versionId="5.0" xsi:type="LocalizedMethodFault"><fault xsi:type="VimEsxCLICLIFault"><errMsg>Got no data from process.
      Command &quot;/bin/vmkfstools-wrapper.sh -s /vmfs/volumes/eco-iscsi-ds3/tshefi-linux9/tshefi-linux9.vmdk -t /vmfs/devices/disks/naa.600a098038313954492458313031764a &quot;
      еxited with error code: 1</errMsg></fault><localizedMessage>EsxCLI.CLIFault.summary</localizedMessage></obj>
      E0709 09:29:34.471651 1 client.go:57] Failed to run esxcli command: <nil> EsxCLI.CLIFault.summary *esx.Fault
      I0709 09:29:34.471748 1 remote_esxcli.go:201] error during copy, response from esxcli []
      I0709 09:29:34.471762 1 remote_esxcli.go:180] cleaning up - unmap and rescan to clean dead devices
      I0709 09:29:34.717001 1 client.go:54] about to run esxcli command [storage core adapter rescan -t delete -a 1]
      I0709 09:29:34.766794 1 remote_esxcli.go:195] rescan to delete dead devices completed
      I0709 09:29:34.824531 1 vsphere-xcopy-volume-populator.go:128] channel quit EsxCLI.CLIFault.summary
      F0709 09:29:34.824575 1 vsphere-xcopy-volume-populator.go:130] EsxCLI.CLIFault.summary
      
      
      When I logged-into the esxi figured I'd restart hostd,
      
      [root@ecoesxi01:/var/log] esxcli software vib list | grep -i redhat vmkfstools-wrapper             0.1.1                                 REDHAT  CommunitySupported  2025-07-09    host 
      
      [root@ecoesxi01:/var/log] /etc/init.d/hostd restart
      hostd stopped.
      Error loading plugin /usr/lib/vmware/esxcli/ext/esxcli-vmkfstools.xml skipping.  Error was: Unable to handle XML Plugin /usr/lib/vmware/esxcli/ext/esxcli-vmkfstools.xml.  There was an error while parsing: Unable to register the command 'esxcli vmkfstools.clone'  Error was Unable to find <input-spec> element, which is required for a command.
      hostd started.
      
      Attached a few logs, also noticed a few files (53) under /var/log/hostd-live*.log, attached the last one from today
      [root@ecoesxi01:/var/log] ll hostd-live-*.dmp -h
      -rw-r--r--    1 root     root       23.7K Apr  2 11:39 hostd-live-2099035-0001.dmp
      -rw-r--r--    1 root     root       22.6K Apr  2 14:31 hostd-live-66466325-0001.dmp
      ...70158716-0001.dmp
      -rw-r--r--    1 root     root       23.4K May  5 13:07 hostd-live-70815628-0001.dmp
      -rw-r--r--    1 root     root       23.9K Jul  9 16:19 hostd-live-70834515-0001.dmp
       

       

      Expected results:

       

      Additional info:

       

              rgolan1@redhat.com Roy Golan
              tshefi@redhat.com Tzach Shefi
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

                Created:
                Updated: