Hi. This isn't a CI only thing and it should be documented. The exact state of affairs right now may be a bit different but in short:
There are certain configurations we don't allow on dataplane. If encountered the operator won't successfully reconcile deployment and
throw error. Now this is one of those cases, but there are others. Under ideal circumstances we would document all of them in some fashion
I'm not sure how feasible that is, but I can help in some fashion.
It would be a good idea, imho, to get this information about other operators as well, not just openstack-operator.
Checks like this are a good practice and necessary, so I expect many of them would have something of the kind.
Since the problem described in this issue should be resolved in a recent advisory, it has been closed.
For information on the advisory (Important: Control plane Operators for RHOSO 18.0.3 (Feature Release 1) security update), and where to find the updated files, follow the link below.
If the solution does not work for you, open a new bug report.
https://access.redhat.com/errata/RHSA-2024:9485