Description of problem:

The `A MachineOSConfig with custom containerfile definition can be successfully applied` OnClusterBuild test is flaky and has a 7-day pass rate below 95%.

Version-Release number of selected component (if applicable):

Seen in 4.20, possible in other versions.

How reproducible:

Failures happen intermittently, I have not been able to reproduce locally.

Steps to Reproduce:

See the following test runs, divided by failure type, to see examples of the test failures:

• Some condition not met
  • Succeeded
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive-techpreview
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive-techpreview
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive-techpreview
  • Building
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive-techpreview
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive-techpreview
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive-techpreview
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive-techpreview
    • e2e-metal-ipi-ovn-ipv6-mco-disruptive-techpreview
• Image not removed on OCL disable
  • e2e-metal-ipi-ovn-ipv4-mco-disruptive-techpreview
  • e2e-metal-ipi-ovn-ipv4-mco-disruptive
  • e2e-vsphere-mco-disruptive-techpreview

Actual results:

The test fail with various issues, which can be seen in the above linked test examples.

Expected results:

The test should consistently pass.    

Additional info:

N/A