Summary

The fix for the podman container cleanup race condition (COS-3949) has been merged in https://github.com/coreos/fedora-coreos-pipeline/pull/1302, but it needs to be deployed to the RHCOS builders.

Background

PR #1302 adds '--filter until=1h' to the container prune command to prevent race conditions where prune removes containers before podman build can clean them up. This was causing builds to fail with exit code 125: "identifier is not a container".

Deployment Options

Per dustymabe's comment on the PR:

"The hard part about this now is that you have to either reprovision all the builders OR SSH and hand edit the jobs."

Options:
1. Reprovision all builders - cleanest approach, ensures consistent state
2. SSH and manually edit the jobs - faster but requires manual intervention on each builder

Related

• Fix PR: https://github.com/coreos/fedora-coreos-pipeline/pull/1302
• Root cause ticket: COS-3949