Goal:

• All build customizations are used in images CI and they are verified to be working as intended.

Acceptance Criteria:

• Every build customization is tested at least once.
• The intended effect of each customization is verified.

Implementation ideas

• A test should verify that all customizations are covered. Adding a customization without testing it should be considered a failure.
  • In rare cases, it should be possible to skip testing a customization (only for exceptional cases).
• This test could be implemented as a command (python script or go binary) that can consume a test config (as they are defined now in osbuild/images:test/configs/) and output a series of tests that can inspect a live image for the expected outcomes (perhaps as an ansible playbook).