What were you trying to do that didn't work?

Could not save multiple guests via auto shutdown

Please provide the package NVR for which the bug is seen:

libvirt-11.3.0-1.el10.x86_64

How reproducible is this bug?:

100%

Steps to reproduce

1. Prepare multiple guests

# virsh list --all
 Id   Name             State
---------------------------------
 1    avocado-vt-vm1   running
 2    avocado-vt-vm2   running
 3    avocado-vt-vm3   running

2. Set the auto shutdown parameters

# grep -v -e '^#' -e '^$' /etc/libvirt/qemu.conf
auto_shutdown_try_save = "persistent"
auto_shutdown_restore = 0

3. Reboot the host

4. Check the save file

# ll /var/lib/libvirt/qemu/save/avocado-vt-vm*.save
-rw-------. 1 root root 686370705 Jun  5 04:24 /var/lib/libvirt/qemu/save/avocado-vt-vm1.save

5. Check the log

1. grep -Ei "qemuDomainLogAppendMessage|DomainDriverAutoShutdown" /var/log/libvirt/virtqemud.log
   2025-06-05 08:24:44.934+0000: 2925: debug : virDomainDriverAutoShutdown:741 : Run autoshutdown uri=qemu:///system trySave=persistent tryShutdown=none poweroff=none waitShutdownSecs=0 saveBypassCache=0 autoRestore=0
   2025-06-05 08:24:44.935+0000: 2925: debug : virDomainDriverAutoShutdown:789 : Auto shutdown with 3 running domains
   2025-06-05 08:24:44.936+0000: 2925: info : virDomainDriverAutoShutdown:823 : Suspending 'avocado-vt-vm1'
   2025-06-05 08:24:44.952+0000: 2925: info : virDomainDriverAutoShutdown:823 : Suspending 'avocado-vt-vm2'
   2025-06-05 08:24:44.966+0000: 2925: info : virDomainDriverAutoShutdown:823 : Suspending 'avocado-vt-vm3'
   2025-06-05 08:24:44.979+0000: 2925: info : virDomainDriverAutoShutdown:845 : Saving 'avocado-vt-vm1'
   2025-06-05 08:24:48.435+0000: 2925: debug : qemuDomainLogAppendMessage:5702 : Append log message (vm='avocado-vt-vm1' message='2025-06-05 08:24:48.435+0000: shutting down, reason=saved
   2025-06-05 08:24:48.689+0000: 2925: info : virDomainDriverAutoShutdown:845 : Saving 'avocado-vt-vm2'
   2025-06-05 08:24:50.658+0000: 2430: debug : qemuDomainLogAppendMessage:5702 : Append log message (vm='avocado-vt-vm2' message='2025-06-05 08:24:50.658+0000: shutting down, reason=shutdown
   2025-06-05 08:24:54.797+0000: 2430: debug : qemuDomainLogAppendMessage:5702 : Append log message (vm='avocado-vt-vm3' message='2025-06-05 08:24:54.797+0000: shutting down, reason=crashed
   2025-06-05 08:24:56.872+0000: 2925: warning : virDomainDriverAutoShutdown:848 : auto-shutdown: unable to perform managed save of 'avocado-vt-vm2': operation failed: domain is no longer running
   2025-06-05 08:24:56.872+0000: 2925: info : virDomainDriverAutoShutdown:845 : Saving 'avocado-vt-vm3'
   2025-06-05 08:24:56.872+0000: 2925: warning : virDomainDriverAutoShutdown:848 : auto-shutdown: unable to perform managed save of 'avocado-vt-vm3': Requested operation is not valid: domain is not running
   2025-06-05 08:24:56.873+0000: 2925: info : virDomainDriverAutoShutdown:938 : Processed 3 domains

Expected results

Guests can be saved successfully

Additional info

Sometimes log will be like this:

2025-06-05 08:26:08.515+0000: 2924: warning : virDomainDriverAutoShutdown:848 : auto-shutdown: unable to perform managed save of 'avocado-vt-vm1': operation failed: domain is no longer running
2025-06-05 08:26:08.515+0000: 2924: info : virDomainDriverAutoShutdown:845 : Saving 'avocado-vt-vm3'
2025-06-05 08:26:08.516+0000: 2924: warning : virDomainDriverAutoShutdown:848 :auto-shutdown: unable to perform managed save of 'avocado-vt-vm3': internal error: End of file from qemu monitor (vm='avocado-vt-vm3')
2025-06-05 08:26:08.516+0000: 2924: info : virDomainDriverAutoShutdown:845 : Saving 'avocado-vt-vm2'
2025-06-05 08:26:08.528+0000: 2924: warning : virDomainDriverAutoShutdown:848 : auto-shutdown: unable to perform managed save of 'avocado-vt-vm2': Requested operation is not valid: domain is not running