2024-10-14 17:41:36.464 1 INFO ironic.conductor.task_manager [None req-cb687b63-7e3a-4dcf-ad64-296a25dfe047 07d2dbaa643e45c8b9ba149c22695d97 f73492db70514f138899f60031a8583c - - default default] Node d6b01cdb-7ade-4c27-b8b0-2aa5305434b9 moved to provision state "manageable" from state "verifying"; target provision state is "None"
2024-10-14 17:41:36.466 1 INFO ironic.conductor.verify [None req-cb687b63-7e3a-4dcf-ad64-296a25dfe047 07d2dbaa643e45c8b9ba149c22695d97 f73492db70514f138899f60031a8583c - - default default] Successfully verified node d6b01cdb-7ade-4c27-b8b0-2aa5305434b9
2024-10-14 17:41:38.046 1 INFO ironic.conductor.task_manager [None req-ffea8c17-c28e-47bd-b717-315516ffcad6 07d2dbaa643e45c8b9ba149c22695d97 f73492db70514f138899f60031a8583c - - default default] Node d6b01cdb-7ade-4c27-b8b0-2aa5305434b9 moved to provision state "cleaning" from state "manageable"; target provision state is "available"
2024-10-14 17:42:39.212 1 ERROR ironic.conductor.utils [None req-ffea8c17-c28e-47bd-b717-315516ffcad6 07d2dbaa643e45c8b9ba149c22695d97 f73492db70514f138899f60031a8583c - - default default] Validation of node d6b01cdb-7ade-4c27-b8b0-2aa5305434b9 for cleaning failed: Could not retrieve network: HttpException: 502: Server Error for url: https://neutron-internal.openstack.svc:9696/v2.0/networks?name=baremetal, response from an upstream server.: The proxy server received an invalid: The proxy server could not handle the requestReason: Error reading from remote server: 502 Proxy Error: Proxy Error: ironic.common.exception.NetworkError: Could not retrieve network: HttpException: 502: Server Error for url: https://neutron-internal.openstack.svc:9696/v2.0/networks?name=baremetal, response from an upstream server.: The proxy server received an invalid: The proxy server could not handle the requestReason: Error reading from remote server: 502 Proxy Error: Proxy Error
2024-10-14 17:42:40.581 1 INFO ironic.drivers.modules.network.neutron [None req-ffea8c17-c28e-47bd-b717-315516ffcad6 07d2dbaa643e45c8b9ba149c22695d97 f73492db70514f138899f60031a8583c - - default default] Removing ports from cleaning network for node d6b01cdb-7ade-4c27-b8b0-2aa5305434b9
2024-10-14 17:42:41.166 1 INFO ironic.common.neutron [None req-ffea8c17-c28e-47bd-b717-315516ffcad6 07d2dbaa643e45c8b9ba149c22695d97 f73492db70514f138899f60031a8583c - - default default] Successfully removed node d6b01cdb-7ade-4c27-b8b0-2aa5305434b9 neutron ports.
2024-10-14 17:42:41.268 1 ERROR ironic.conductor.task_manager [None req-ffea8c17-c28e-47bd-b717-315516ffcad6 07d2dbaa643e45c8b9ba149c22695d97 f73492db70514f138899f60031a8583c - - default default] Node d6b01cdb-7ade-4c27-b8b0-2aa5305434b9 moved to provision state "clean failed" from state "cleaning"; target provision state is "available": ironic.common.exception.NetworkError: Could not retrieve network: HttpException: 502: Server Error for url: https://neutron-internal.openstack.svc:9696/v2.0/networks?name=baremetal, response from an upstream server.: The proxy server received an invalid: The proxy server could not handle the requestReason: Error reading from remote server: 502 Proxy Error: Proxy Error 

2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance res_map['ovn_create'](context, n_obj)
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 624, in create_port
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self._qos_driver.create_port(txn, port, port_cmd)
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen)
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 274, in transaction
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance yield t
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance next(self.gen)
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.9/site-packages/ovsdbapp/api.py", line 120, in transaction
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance del self._nested_txns_map[cur_thread_id]
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.9/site-packages/ovsdbapp/api.py", line 71, in __exit__
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance self.result = self.commit()
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 56, in commit
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance raise exceptions.TimeoutException(
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance ovsdbapp.exceptions.TimeoutException: Commands [HAChassisGroupDelChassisCommand(_result=None, hcg=neutron-d6a8b61f-e322-4a7e-bb11-766d540c4cd9, chassis=166b2408-3c7f-49ec-baa0-0247abee5444, if_exists=True), HAChassisGroupAddChassisCommand(_result=e8f7937b-fc90-4824-9f66-40b06acd8b03, hcg=neutron-d6a8b61f-e322-4a7e-bb11-766d540c4cd9, chassis=bbe8c199-3373-4a9a-94d7-b138a2091b78, priority=32767, columns={}), HAChassisGroupAddChassisCommand(_result=67415d05-5e3f-4a65-9fe3-b0b34eab22cb, hcg=neutron-d6a8b61f-e322-4a7e-bb11-766d540c4cd9, chassis=acba2525-d132-4fbe-a1ca-0b5ba6851d4f, priority=32766, columns={}), AddLSwitchPortCommand(_result=f5c34ca3-fd26-4cd3-8a68-d6069b7593a5, lport=8b8fd6b5-a173-4e0e-acc2-108969fa55a8, lswitch=neutron-d6a8b61f-e322-4a7e-bb11-766d540c4cd9, may_exist=True, columns={'addresses': ['fa:16:3e:ec:d5:9c 172.20.144.164'], 'external_ids': {'neutron:port_name': '', 'neutron:device_id': 'cf8ac06...
2024-10-14 17:26:27.140 20 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance
2024-10-14 17:26:28.437 21 WARNING neutron.db.agents_db [None req-d1e703a7-4733-412d-9c26-025e1d77959d - - - - - -] Agent healthcheck: found 3 dead agents out of 4:
Type Last heartbeat host
Baremetal Node 2024-10-09 14:59:55 9cf38d8d-aec6-4586-8389-9b9247e5eb80
Baremetal Node 2024-10-11 14:01:39 967425fa-9484-4498-a2a3-7669814e5fed
Baremetal Node 2024-10-09 14:37:25 39e5b258-0bde-4981-8ae8-b15b2dba6c28