Beginning with 4.16.0-0.nightly-2024-03-02-040702 payloads are failing with jobs that install the current payload (upgrades are working). The issues appear related to mco-audit-quiet-containers.rules: Permission denied as seen in periodic-ci-openshift-release-master-ci-4.16-e2e-aws-ovn and multiple other runs.

It looks like 4158 came in starting with this payload and refactors the reconcile / daemon update code in play here. Will begin with testing a revert to see if we get a clear signal that it is related.    Testing on the revert still showed the issue.

The prior payload 4.16.0-0.nightly-2024-02-29-062601 shows updates to `mco-audit-quiet-containers.rules` appear to succeed when reviewing machine-config-daemon.log

4.16.0-0.nightly-2024-03-02-040702 and 4.16.0-0.ci-2024-03-02-050656 both show:

CentOS Stream CoreOS upgraded from 416.94.202402232016-0 to 416.94.202403011839-0 (diff).

Could a file / file permission have changed via the CoreOS change?