2024-08-03 11:47:48.645 14 ERROR ovsdbapp.backend.ovs_idl.transaction [req-2ae0b710-95aa-4cf7-83bf-f02de3e0f874 req-e3f965a8-ab10-41f9-b183-ea4171e22bb1 ea8139f1cf604ca2a1f8a0084857a5b4 6771a0fd6216469a88f73efe457de6ea - - default default] Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/ovsdbapp/schema/ovn_northbound/commands.py", line 1706, in run_idl pg = self.api.lookup('Port_Group', self.port_group) File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 183, in lookup return self._lookup(table, record) File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 234, in _lookup row = idlutils.row_by_value(self, rl.table, rl.column, record) File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 114, in row_by_value raise RowNotFound(table=table, col=column, match=match) ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Port_Group with name=pg_3bee541f_eba6_4ece_a0c5_17892fc08629 The above exception was the direct cause of the following exception: Traceback (most recent call last): File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 118, in run txn.results.put(txn.do_commit()) File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 92, in do_commit command.run_idl(txn) File "/usr/lib/python3.9/site-packages/ovsdbapp/schema/ovn_northbound/commands.py", line 1708, in run_idl raise RuntimeError('Port group %s does not exist' % RuntimeError: Port group pg_3bee541f_eba6_4ece_a0c5_17892fc08629 does not exist  2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers [req-2ae0b710-95aa-4cf7-83bf-f02de3e0f874 req-e3f965a8-ab10-41f9-b183-ea4171e22bb1 ea8139f1cf604ca2a1f8a0084857a5b4 6771a0fd6216469a88f73efe457de6ea - - default default] Mechanism driver 'ovn' failed in create_port_postcommit: RuntimeError: Port group pg_3bee541f_eba6_4ece_a0c5_17892fc08629 does not exist 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers Traceback (most recent call last): 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/schema/ovn_northbound/commands.py", line 1706, in run_idl 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers pg = self.api.lookup('Port_Group', self.port_group) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 183, in lookup 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers return self._lookup(table, record) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/__init__.py", line 234, in _lookup 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers row = idlutils.row_by_value(self, rl.table, rl.column, record) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/idlutils.py", line 114, in row_by_value 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers raise RowNotFound(table=table, col=column, match=match) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Port_Group with name=pg_3bee541f_eba6_4ece_a0c5_17892fc08629 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers The above exception was the direct cause of the following exception: 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers Traceback (most recent call last): 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/managers.py", line 497, in _call_on_drivers 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers getattr(driver.obj, method_name)(context) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/mech_driver.py", line 802, in create_port_postcommit 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers self._ovn_client.create_port(context.plugin_context, port) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 607, in create_port 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers self._qos_driver.create_port(txn, port, port_cmd) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__ 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers next(self.gen) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 274, in transaction 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers yield t 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib64/python3.9/contextlib.py", line 126, in __exit__ 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers next(self.gen) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/api.py", line 120, in transaction 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers del self._nested_txns_map[cur_thread_id] 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/api.py", line 71, in __exit__ 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers self.result = self.commit() 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers raise result.ex 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 118, in run 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers txn.results.put(txn.do_commit()) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 92, in do_commit 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers command.run_idl(txn) 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers File "/usr/lib/python3.9/site-packages/ovsdbapp/schema/ovn_northbound/commands.py", line 1708, in run_idl 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers raise RuntimeError('Port group %s does not exist' % 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers RuntimeError: Port group pg_3bee541f_eba6_4ece_a0c5_17892fc08629 does not exist 2024-08-03 11:47:48.645 14 ERROR neutron.plugins.ml2.managers  2024-08-03 11:47:48.646 14 ERROR neutron.plugins.ml2.plugin [req-2ae0b710-95aa-4cf7-83bf-f02de3e0f874 req-e3f965a8-ab10-41f9-b183-ea4171e22bb1 ea8139f1cf604ca2a1f8a0084857a5b4 6771a0fd6216469a88f73efe457de6ea - - default default] mechanism_manager.create_port_postcommit failed, deleting port '9461937f-6af8-418e-9800-5084cc2399c7': neutron.plugins.ml2.common.exceptions.MechanismDriverError 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation [req-2ae0b710-95aa-4cf7-83bf-f02de3e0f874 req-e3f965a8-ab10-41f9-b183-ea4171e22bb1 ea8139f1cf604ca2a1f8a0084857a5b4 6771a0fd6216469a88f73efe457de6ea - - default default] POST failed.: neutron.plugins.ml2.common.exceptions.MechanismDriverError 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation Traceback (most recent call last): 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/pecan/core.py", line 693, in __call__ 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.invoke_controller(controller, args, kwargs, state) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/pecan/core.py", line 584, in invoke_controller 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation result = controller(*args, **kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 142, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation setattr(e, '_RETRY_EXCEEDED', True) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation raise self.value 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 138, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f(*args, **kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_db/api.py", line 154, in wrapper 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation ectxt.value = e.inner_exc 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation raise self.value 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_db/api.py", line 142, in wrapper 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f(*args, **kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 190, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation context_reference.session.rollback() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation raise self.value 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 184, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f(*dup_args, **dup_kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/pecan_wsgi/controllers/utils.py", line 65, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f(*args, **kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/pecan_wsgi/controllers/resource.py", line 163, in post 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return self.create(resources) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/pecan_wsgi/controllers/resource.py", line 181, in create 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return {key: creator(*creator_args, **creator_kwargs)} 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/common/utils.py", line 731, in inner 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f(*args, **kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 226, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f_with_retry(*args, **kwargs, 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 142, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation setattr(e, '_RETRY_EXCEEDED', True) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation raise self.value 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 138, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f(*args, **kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_db/api.py", line 154, in wrapper 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation ectxt.value = e.inner_exc 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation raise self.value 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_db/api.py", line 142, in wrapper 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f(*args, **kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 190, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation context_reference.session.rollback() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation raise self.value 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron_lib/db/api.py", line 184, in wrapped 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return f(*dup_args, **dup_kwargs) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/plugin.py", line 1586, in create_port 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation return self._after_create_port(context, result, mech_context) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/plugin.py", line 1603, in _after_create_port 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.delete_port(context, result['id'], l3_port_check=False) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 227, in __exit__ 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.force_reraise() 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/oslo_utils/excutils.py", line 200, in force_reraise 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation raise self.value 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/plugin.py", line 1598, in _after_create_port 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self.mechanism_manager.create_port_postcommit(mech_context) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/managers.py", line 735, in create_port_postcommit 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation self._call_on_drivers("create_port_postcommit", context) 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation File "/usr/lib/python3.9/site-packages/neutron/plugins/ml2/managers.py", line 513, in _call_on_drivers 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation raise ml2_exc.MechanismDriverError( 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation neutron.plugins.ml2.common.exceptions.MechanismDriverError 2024-08-03 11:47:48.817 14 ERROR neutron.pecan_wsgi.hooks.translation