Uploaded image for project: 'RHEL'
  1. RHEL
  2. RHEL-112098

ImageMode: VM is dead due to a kernel crash, see debug/serial log for details

Linking RHIVOS CVEs to...Migration: Automation ...SWIFT: POC ConversionSync from "Extern...XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • None
    • rhel-9.7
    • qemu-kvm
    • No
    • Important
    • rhel-virt-core
    • None
    • QE ack
    • False
    • False
    • Hide

      None

      Show
      None
    • None
    • Red Hat Enterprise Linux
    • None
    • Unspecified
    • Unspecified
    • Unspecified
    • x86_64
    • Linux
    • None

      What were you trying to do that didn't work?
      QE got a mission named "RHELMISC-16372 [dump_test] rhel-sst-virtualization-windows - SST Testing on Image Mode for RHEL9.7". During the testing of qemu_dump, QE found that installation windows suddenly went black and quit later. QE tried to boot the VM again, but the boot process could load for one or two seconds and then crash directly. Our avocado-vt returns "VM is dead due to a kernel crash, see debug/serial log for details". After this situation, QE tried to reinstall the same hardware machine with the same RHEL9.7 version in package mode, which showed that everything worked well.

      Please provide the package NVR for which bug is seen:

      • DISTRO=RHEL-9.7.0-20250826.5
      • CPU=Intel(R) Xeon(R) Silver 4310 CPU @ 2.10GHz
      • kernel-5.14.0-605.el9.x86_64
      • seabios-bin-1.16.3-4.el9.noarch
      • edk2-ovmf-20241117-4.el9.noarch
      • swtpm-0.8.0-2.el9_4.x86_64
      • qemu-kvm-core-9.1.0-25.el9.x86_64

      How reproducible:
      100%

      Steps to reproduce
      1. Boot the following qemu command line to set up the OS.

      /usr/libexec/qemu-kvm \
      -name 'avocado-vt-vm1'  \
      -sandbox on,elevateprivileges=deny,obsolete=deny,resourcecontrol=deny \
      -blockdev '{"node-name": "file_ovmf_code", "driver": "file", "filename": "/usr/share/OVMF/OVMF_CODE.secboot.fd", "auto-read-only": true, "discard": "unmap"}' \
      -blockdev '{"node-name": "drive_ovmf_code", "driver": "raw", "read-only": true, "file": "file_ovmf_code"}' \
      -blockdev '{"node-name": "file_ovmf_vars", "driver": "file", "filename": "/root/avocado/data/avocado-vt/avocado-vt-vm1_rhel970-64-bootc-virtio-scsi-ovmf_qcow2_filesystem_VARS.raw", "auto-read-only": true, "discard": "unmap"}' \
      -blockdev '{"node-name": "drive_ovmf_vars", "driver": "raw", "read-only": false, "file": "file_ovmf_vars"}' \
      -machine q35,pflash0=drive_ovmf_code,pflash1=drive_ovmf_vars,memory-backend=mem-machine_mem \
      -device '{"id": "pcie-root-port-0", "driver": "pcie-root-port", "multifunction": true, "bus": "pcie.0", "addr": "0x1", "chassis": 1}' \
      -device '{"id": "pcie-pci-bridge-0", "driver": "pcie-pci-bridge", "addr": "0x0", "bus": "pcie-root-port-0"}'  \
      -nodefault\
      -device '{"driver": "VGA", "bus": "pcie.0", "addr": "0x2"}' \
      -m 125952 \
      -objec'{"size": 132070244352, "id": "mem-machine_mem", "qom-type": "memory-backend-ram"}'  \
      -smp 24,maxcpus=24,cores=12,threads=1,dies=1,sockets=2  \
      -cpu 'Icelake-Server',dtes64=on,vmx=on,pdcm=on,hypervisor=on,ds=on,ss=on,tsc-adjust=on,avx512ifma=on,sha-ni=on,rdpid=on,fsrm=on,md-clear=on,stibp=on,flush-l1d=on,arch-capabilities=on,xsaves=on,ibpb=on,ibrs=on,amd-stibp=on,amd-ssbd=on,rdctl-no=on,ibrs-all=on,skip-l1dfl-vmentry=on,mds-no=on,pschange-mc-no=on,tsx-ctrl=on,sbdr-ssdp-no=on,psdp-no=on,fb-clear=on,gds-no=on,rfds-no=on,vmx-ins-outs=on,vmx-true-ctls=on,vmx-store-lma=on,vmx-activity-hlt=on,vmx-activity-wait-sipi=on,vmx-vmwrite-vmexit-fields=on,vmx-apicv-xapic=on,vmx-ept=on,vmx-desc-exit=on,vmx-rdtscp-exit=on,vmx-apicv-x2apic=on,vmx-vpid=on,vmx-wbinvd-exit=on,vmx-unrestricted-guest=on,vmx-apicv-register=on,vmx-apicv-vid=on,vmx-rdrand-exit=on,vmx-invpcid-exit=on,vmx-vmfunc=on,vmx-shadow-vmcs=on,vmx-rdseed-exit=on,vmx-pml=on,vmx-xsaves=on,vmx-tsc-scaling=on,vmx-ept-execonly=on,vmx-page-walk-4=on,vmx-page-walk-5=on,vmx-ept-2mb=on,vmx-ept-1gb=on,vmx-invept=on,vmx-eptad=on,vmx-invept-single-context=on,vmx-invept-all-context=on,vmx-invvpid=on,vmx-invvpid-single-addr=on,vmx-invvpid-all-context=on,vmx-invept-single-context-noglobals=on,vmx-intr-exit=on,vmx-nmi-exit=on,vmx-vnmi=on,vmx-preemption-timer=on,vmx-posted-intr=on,vmx-vintr-pending=on,vmx-tsc-offset=on,vmx-hlt-exit=on,vmx-invlpg-exit=on,vmx-mwait-exit=on,vmx-rdpmc-exit=on,vmx-rdtsc-exit=on,vmx-cr3-load-noexit=on,vmx-cr3-store-noexit=on,vmx-cr8-load-exit=on,vmx-cr8-store-exit=on,vmx-flexpriority=on,vmx-vnmi-pending=on,vmx-movdr-exit=on,vmx-io-exit=on,vmx-io-bitmap=on,vmx-mtf=on,vmx-msr-bitmap=on,vmx-monitor-exit=on,vmx-pause-exit=on,vmx-secondary-ctls=on,vmx-exit-nosave-debugctl=on,vmx-exit-load-perf-global-ctrl=on,vmx-exit-ack-intr=on,vmx-exit-save-pat=on,vmx-exit-load-pat=on,vmx-exit-save-efer=on,vmx-exit-load-efer=on,vmx-exit-save-preemption-timer=on,vmx-entry-noload-debugctl=on,vmx-entry-ia32e-mode=on,vmx-entry-load-perf-global-ctrl=on,vmx-entry-load-pat=on,vmx-entry-load-efer=on,vmx-eptp-switching=on,hle=off,rtm=off,intel-pt=off,mpx=off,kvm_pv_unhalt=on \
      -chardev socket,id=qmp_id_qmpmonitor1,server=on,wait=off,path=/var/tmp/avocado_2c1wfmoj/monitor-qmpmonitor1-20250901-010226-EW8cthz3  \
      -mon chardev=qmp_id_qmpmonitor1,mode=contro\
      -chardev socket,id=qmp_id_catch_monitor,server=on,wait=off,path=/var/tmp/avocado_2c1wfmoj/monitor-catch_monitor-20250901-010226-EW8cthz3  \
      -mon chardev=qmp_id_catch_monitor,mode=contro\
      -device '{"ioport": 1285, "driver": "pvpanic", "id": "idkQEF7t"}' \
      -chardev socket,id=chardev_serial0,server=on,wait=off,path=/var/tmp/avocado_2c1wfmoj/serial-serial0-20250901-010226-EW8cthz3 \
      -device '{"id": "serial0", "driver": "isa-serial", "chardev": "chardev_serial0"}'  \
      -chardev socket,id=seabioslog_id_20250901-010226-EW8cthz3,path=/var/tmp/avocado_2c1wfmoj/seabios-20250901-010226-EW8cthz3,server=on,wait=off \
      -device isa-debugcon,chardev=seabioslog_id_20250901-010226-EW8cthz3,iobase=0x402 \
      -device '{"id": "pcie-root-port-1", "port": 1, "driver": "pcie-root-port", "addr": "0x1.0x1", "bus": "pcie.0", "chassis": 2}' \
      -device '{"driver": "qemu-xhci", "id": "usb1", "bus": "pcie-root-port-1", "addr": "0x0"}' \
      -device '{"driver": "usb-tablet", "id": "usb-tablet1", "bus": "usb1.0", "port": "1"}' \
      -device '{"id": "pcie-root-port-2", "port": 2, "driver": "pcie-root-port", "addr": "0x1.0x2", "bus": "pcie.0", "chassis": 3}' \
      -device '{"id": "virtio_scsi_pci0", "driver": "virtio-scsi-pci", "bus": "pcie-root-port-2", "addr": "0x0"}' \
      -blockdev '{"node-name": "file_image1", "driver": "file", "auto-read-only": true, "discard": "unmap", "aio": "threads", "filename": "/var/home/kvm_autotest_root/images/rhel970-64-bootc-virtio-scsi-ovmf.qcow2", "cache": {"direct": true, "no-flush": false}}' \
      -blockdev '{"node-name": "drive_image1", "driver": "qcow2", "read-only": false, "cache": {"direct": true, "no-flush": false}, "file": "file_image1"}' \
      -device '{"driver": "scsi-hd", "id": "image1", "drive": "drive_image1", "write-cache": "on"}' \
      -device '{"id": "pcie-root-port-3", "port": 3, "driver": "pcie-root-port", "addr": "0x1.0x3", "bus": "pcie.0", "chassis": 4}' \
      -device '{"driver": "virtio-net-pci", "mac": "9a:e6:35:dc:9c:be", "id": "idu0MHvi", "netdev": "idKVK6qF", "bus": "pcie-root-port-3", "addr": "0x0"}' \
      -netdev  '{"id": "idKVK6qF", "type": "tap", "vhost": true, "vhostfd": "16", "fd": "12"}' \
      -blockdev '{"node-name": "drive_cd1", "driver": "file", "read-only": true, "discard": "unmap", "aio": "threads", "filename": "/var/home/kvm_autotest_root/iso/linux/RHEL-9.7.0-20250829.0-x86_64-dvd1.iso", "cache": {"direct": true, "no-flush": false}}' \
      -device '{"driver": "scsi-cd", "id": "cd1", "drive": "drive_cd1", "write-cache": "on"}' \
      -blockdev '{"node-name": "drive_unattended", "driver": "file", "read-only": true, "discard": "unmap", "aio": "threads", "filename": "/var/home/kvm_autotest_root/images/rhel970-64/ks.iso", "cache": {"direct": true, "no-flush": false}}' \
      -device '{"driver": "scsi-cd", "id": "unattended", "drive": "drive_unattended", "write-cache": "on"}'  \
      -kerne'/var/home/kvm_autotest_root/images/rhel970-64/vmlinuz'  \
      -appen'inst.sshinst.ks=cdrom:/ks.cfnet.ifnames=0 inst.repo=cdrom console=ttyS0,115200'  \
      -initr'/var/home/kvm_autotest_root/images/rhel970-64/initrd.img'  \
      -vnc :0  \
      -rtc base=utc,clock=host,driftfix=slew  \
      -boomenu=off,order=cdn,once=d,strict=off  \
      -no-shutdown \
      -chardev socket,id=char_vtpm_avocado-vt-vm1_tpm0,path=/root/avocado/data/avocado-vt/swtpm/avocado-vt-vm1_tpm0_swtpm.sock \
      -tpmdev emulator,chardev=char_vtpm_avocado-vt-vm1_tpm0,id=emulator_vtpm_avocado-vt-vm1_tpm0 \
      -device '{"id": "tpm-crb_vtpm_avocado-vt-vm1_tpm0", "tpmdev": "emulator_vtpm_avocado-vt-vm1_tpm0", "driver": "tpm-crb"}' \
      -enable-kvm \
      -device '{"id": "pcie_extra_root_port_0", "driver": "pcie-root-port", "multifunction": true, "bus": "pcie.0", "addr": "0x3", "chassis": 5}'
      

      Expected results
      Sucessful installation without any error code, just like the package mode.

      Actual results
      "VM is dead due to a kernel crash, see debug/serial log for details" on the image mode.

        1. 0071.jpg
          0071.jpg
          24 kB
        2. 0069.jpg
          0069.jpg
          25 kB
        3. 0073.jpg
          0073.jpg
          25 kB
        4. 0070.jpg
          0070.jpg
          24 kB
        5. 0072.jpg
          0072.jpg
          25 kB
        6. 0074.jpg
          0074.jpg
          17 kB

              Unassigned Unassigned
              rh-ee-wji Wenkang Ji
              virt-maint virt-maint
              Wenkang Ji Wenkang Ji
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

                Created:
                Updated:
                Resolved: