Which alerting rules would be useful to have for COO? One obvious rule is to alert on failed reconciliations (controller_runtime_reconcile_errors_total & controller_runtime_reconcile_total) but we should not limit ourselves to the out-of-the-box metrics provided by the controller-runtime library.