This is seen in multiple jobs using multi-node 17.1 deployments.

TASK [cinder_adoption : Cinder online data migrations] ************************* Tuesday 19 November 2024 20:20:32 0000 (0:00:00.036) 0:22:54.935 ****** fatal: [localhost]: FAILED! => {"changed": true, "cmd": "set -euxo pipefail\n\nexport KUBECONFIG=~/adoption/kubeconfig\n\noc exec -it cinder-scheduler-0 – cinder-manage db online_data_migrations\n", "delta": "0:00:00.289041", "end": "2024-11-19 20:20:33.313695", "msg": "non-zero return code", "rc": 1, "start": "2024-11-19 20:20:33.024654", "stderr": " export KUBECONFIG=/home/stack/adoption/kubeconfig\n+ KUBECONFIG=/home/stack/adoption/kubeconfig\n+ oc exec -it cinder-scheduler-0 – cinder-manage db online_data_migrations\nDefaulted container \"cinder-scheduler\" out of: cinder-scheduler, probe\nUnable to use a TTY - input is not a terminal or the right kind of file\nerror: unable to upgrade connection: container not found (\"cinder-scheduler\")", "stderr_lines": ["+ export KUBECONFIG=/home/stack/adoption/kubeconfig", "+ KUBECONFIG=/home/stack/adoption/kubeconfig", "+ oc exec -it cinder-scheduler-0 -- cinder-manage db online_data_migrations", "Defaulted container \"cinder-scheduler\" out of: cinder-scheduler, probe", "Unable to use a TTY - input is not a terminal or the right kind of file", "error: unable to upgrade connection: container not found (\"cinder-scheduler\")"], "stdout": "", "stdout_lines": []}

Main reason for this issue is services not being cleaned up properly

------------------------------------------------------------------------------------+ | Binary | Host | Zone | Status | State | Updated At | -----------------------------------------------------------------------------------+ | cinder-scheduler | controller-0.redhat.local | nova | enabled | down | 2024-11-19T20:18:26.000000 | | cinder-scheduler | controller-1.redhat.local | nova | enabled | down | 2024-11-19T20:18:26.000000 | | cinder-scheduler | controller-2.redhat.local | nova | enabled | down | 2024-11-19T20:18:26.000000 | | cinder-volume | hostgroup@tripleo_iscsi | nova | enabled | down | 2024-11-19T20:18:26.000000 | | cinder-scheduler | cinder-scheduler-0 | nova | enabled | up | 2024-11-19T20:37:38.000000 | ------------------------------------------------------------------------------------+