After a system reboot, the node fails during early boot. The failure occurs while mounting /sysroot, which causes ignition-ostree-transposefs-autosave-xfs.service to fail and leads to subsequent failures in initrd. As a result, the system does not complete the boot process.

4.22

Always

1. Boot the Agent OVE ISO.
2. Wait for the system to reboot.
3. Observe the boot failure during the initrd stage.

A CLI validation tool to check this called ignition-validate can be downloaded from GitHub:
https://github.com/coreos/ignition/releases
Displaying logs from failed units: sysroot.mount ignition-ostree-transposefs-autosave-xfs.service
Feb 0Z 11:46:13 systemd[1]:
sysroot mount: Failed to load environment files: No such file or directory
Feb 0Z 11:46:13 systemd[1]:
sysroot mount: Failed to run 'mount' task: No such file or directory
Feb 02 11:46:13 systemd[1]:
sysroot.mount: Failed with result 'resources'
Feb 0Z 11:46:13 systemd[1]: Failed to mount /sysroot.
Feb OZ 11:46:10 ignition-ostree-transposefs[14321: cp: cannot create directory ' run/ignition-ostree-transposefs/root/ostree/dep loy/rhcos/var/lib/iri-registry/images': No space left on device
Feb 02 11:46:10 ignition-ostree-transposefs[1432]: cp: cannot create symbolic link 'run/ignition-ostree-transposefs/root/ostree
deploy/rhcos/var/run': No space left on device
Feb OZ 11:46:10 ignition-ostree-transposefs[1432]: cp: cannot create regular file '(run/ignition-ostree-transposefs/root/ostree/ deploy/rhcos/var/.ostree-selabeled': No space left on device
Feb OZ 11:46:10 ignition-ostree-transposefs[14321: cp: cannot create directory ' run/ignition-ostree-transposefs/root/ostree/dep
loy/rhcos/var/tmp': No space left on device
Feb 02 11:46:10 ignition-ostree-transposefs[1432]: cp: cannot create directory '/run/ignition-ostree-transposefs/root/ostree/dep
loy/rhcos/backing': No space left on device
Feb OZ 11:46:10 ignition-ostree-transposefs[14321: cp: cannot create directory ' run/ignition-ostree-transposefs/root/ostree/dep
loy rhcos/deploy': No space left on device
Feb OZ 11:46:10 ignition-ostree-transposefs[1432]: cp: cannot create symbolic link '‹run/ignition-ostree-transposefs/root/ostree
/boot. 0': No space left on device
Feb 02 11:46:10 ignition-ostree-transposefs[1432]: cp: cannot create directory '(run/ignition-ostree-transposefs/root/ostree/boo
t.O.1': No space left on device
Feb 0Z 11:46:11 systemd[1]: ignition-ostree-transposefs-autosave-xfs-service: Triggering
OnFailure= dependencies.
Feb 02 11:46:11 systemd[1]: ignition-ostree-transposefs-autosave-xfs.service: Consumed 7.133s CPU time.
Generating "'run/initramfs/rdsosreport.txt"

The cluster should be deployed successfully

 Sysroot.mount service logs: 

Feb 06 15:33:11 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com systemd[1]: sysroot.mount: Failed to load environment fil
es: No such file or directory
Feb 06 15:33:11 master-01.ci-op-tirbyk.im.ocpue.arm.eng.rdu?.redhat.com systemd[1]: susroot mount: Failed to run 'mount' task: No
such file or directory
Feb 06 15:33:11 master-01.ci-op-t.jgbgk.jm.ocpqe.arm.eng.rdu2.redhat.com systemd[1]: sysroot.mount: Failed with result 'resources'
Feb 06 15:33:11 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu?.redhat.com systemd[1]: Failed to mount ‹sysroot.

-------------------------------------------
ignition-ostree-transposefs-autosave-xfs.service
 
Feb 06 15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire ctory 'run/ignition-ostree-transposefs/root/ostree/deploy/rhcos/var/1ib/iri-registry/docker/registry/v2/blobs/sha256/19': No sp
ace left on device
Feb 06 15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rduz.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire ctory'run/ignition-ostree-transposefs/root/ostree/deploy/rhcos/var/1ib/iri-registry/docker/registry/v2/blobs/sha256/71': No sp
ace left on device
Feb 06 15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire ctory 'run/ignition-ostree-transposefs/root/ostree/deploy/rhcos/var/1ib/iri-registry/docker/registry/v2/blobs/sha256/c9': Mo sp
ace left on device
Feb 06 15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire
ctory
'run ignition-ostree-transposefs/root/ostree/deploy/rhcos/var/lib/iri-registry docker/registry v2/repositories' : No space
left on device
Feb 06 15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire ctory 'run ignition-ostree-transposefs/root/ostree/deploy/rhcos/var/lib/iri-registry/images': Mo space left on device Feb 06 15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create symb olic link 'run ignition-ostree-transposefs/root/ostree/deploy/rhcos/var/run': No space left on device
Feb 06 15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create regu
lar file 'run/ignition-ostree-transposefs/root/ostree/deploy/rhcos/var/.ostree-selabeled': No space left on device
15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire
ctory 'run/ignition-ostree-transposefs/root/ostree/deploy/rhcos/var/tmp': No space left on device
Feb 06 15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire
ctory 'run ignition-ostree-transposefs/root/ostree/deploy/rhcos/backing': No space left on device
15:33:03 master-01.ci-op-tjgbykjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire
ctory 'run/ignition-ostree-transposefs/root/ostree/deploy/rhcos/deploy': No space left on device
15:33:03 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com ignition-ostree-transposefs[1425]: cp: cannot create dire
ctory 'run/ignition-ostree-transposefs/root/ostree/boot.O.1': No space left on device
Feb 06 15:33:09 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com systemdl1]: ignition-ostree-transposefs-autosave-xfs.serv
ice: Main process exited, code-exited, status=1/FAILURE
Feb 06 15:33:09 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com systemdI1]: ignition-ostree-transposefs-autosave-xfs.serv
ice: Failed with result 'exit-code'
Feb 06 15:33:09 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com systemd[1]: Failed to start Ignition OSTree: Autosave XFS
Rootfs Partition.
Feb 06 15:33:09 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com systemd[1]: ignition-ostree-transposefs-autosave-xfs.serv
ice: Triggering OnFailure= dependencies.
Feb 06 15:33:09 master-01.ci-op-tjgbgkjm.ocpqe.arm.eng.rdu2.redhat.com systemd[1]: ignition-ostree-transposefs-autosave-xfs.seru
ice: Consumed 7.311s CPU time.