yahoo-eng-team team mailing list archive

Thread
Date
[Bug 2073326] [NEW] [ovn] OVSDB Error ' references nonexistent' occurs when updating one router.

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Liu Xie <2073326@xxxxxxxxxxxxxxxxxx>
Date: Wed, 17 Jul 2024 03:36:49 -0000
Reply-to: Bug 2073326 <2073326@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:

Hi folks, I encountered an issue when updating a router, but I'm not
sure how to reproduce it. Does anyone have any opinions? The phenomenon
is as follows:

When i updating one router:
neutron router-update --name test 22d98f75-063e-4413-b40c-69d1db3d9849

The error logs are:

2024-07-16 16:11:37.651 146 ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}^[[00m
2024-07-16 16:11:37.651 146 ERROR ovsdbapp.backend.ovs_idl.transaction [req-c855bc22-2d9b-48c4-964b-eb0579a75f2c f743596e02534618b855e9a1f8dd1640 a4912dcbde8e4533b9f7128cabf7ab72 - default default] Traceback (most recent call last):
  File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 118, in run
    txn.results.put(txn.do_commit())
  File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
    raise RuntimeError(msg)
RuntimeError: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}
^[[00m
2024-07-16 16:11:37.651 146 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [req-c855bc22-2d9b-48c4-964b-eb0579a75f2c f743596e02534618b855e9a1f8dd1640 a4912dcbde8e4533b9f7128cabf7ab72 - default default] Unable to update router 22d98f75-063e-4413-b40c-69d1db3d9849. Error: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}: RuntimeError: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}^[[00m
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin [req-c855bc22-2d9b-48c4-964b-eb0579a75f2c f743596e02534618b855e9a1f8dd1640 a4912dcbde8e4533b9f7128cabf7ab72 - default default] Unable to update lrouter for 22d98f75-063e-4413-b40c-69d1db3d9849: RuntimeError: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin Traceback (most recent call last):
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/neutron/services/ovn_l3/plugin.py", line 219, in update_router
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     original_router)
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1612, in update_router
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     'error': e})
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/oslo_utils/excutils.py", line 227, in __exit__
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     self.force_reraise()
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     raise self.value
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1594, in update_router
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     self._qos_driver.update_router(txn, new_router)
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     next(self.gen)
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 269, in transaction
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     yield t
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     next(self.gen)
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/api.py", line 110, in transaction
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     del self._nested_txns_map[cur_thread_id]
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/api.py", line 61, in __exit__
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     self.result = self.commit()
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     raise result.ex
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 118, in run
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     txn.results.put(txn.do_commit())
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     raise RuntimeError(msg)
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin RuntimeError: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}
2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin ^[[00m

neutron version: wallaby

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2073326

Title:
  [ovn] OVSDB Error ' references nonexistent'  occurs when updating one
  router.

Status in neutron:
  New

Bug description:
  Hi folks, I encountered an issue when updating a router, but I'm not
  sure how to reproduce it. Does anyone have any opinions? The
  phenomenon is as follows:

  When i updating one router:
  neutron router-update --name test 22d98f75-063e-4413-b40c-69d1db3d9849

  The error logs are:

  2024-07-16 16:11:37.651 146 ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}^[[00m
  2024-07-16 16:11:37.651 146 ERROR ovsdbapp.backend.ovs_idl.transaction [req-c855bc22-2d9b-48c4-964b-eb0579a75f2c f743596e02534618b855e9a1f8dd1640 a4912dcbde8e4533b9f7128cabf7ab72 - default default] Traceback (most recent call last):
    File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 118, in run
      txn.results.put(txn.do_commit())
    File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
      raise RuntimeError(msg)
  RuntimeError: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}
  ^[[00m
  2024-07-16 16:11:37.651 146 ERROR neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_client [req-c855bc22-2d9b-48c4-964b-eb0579a75f2c f743596e02534618b855e9a1f8dd1640 a4912dcbde8e4533b9f7128cabf7ab72 - default default] Unable to update router 22d98f75-063e-4413-b40c-69d1db3d9849. Error: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}: RuntimeError: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}^[[00m
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin [req-c855bc22-2d9b-48c4-964b-eb0579a75f2c f743596e02534618b855e9a1f8dd1640 a4912dcbde8e4533b9f7128cabf7ab72 - default default] Unable to update lrouter for 22d98f75-063e-4413-b40c-69d1db3d9849: RuntimeError: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin Traceback (most recent call last):
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/neutron/services/ovn_l3/plugin.py", line 219, in update_router
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     original_router)
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1612, in update_router
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     'error': e})
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/oslo_utils/excutils.py", line 227, in __exit__
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     self.force_reraise()
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     raise self.value
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1594, in update_router
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     self._qos_driver.update_router(txn, new_router)
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     next(self.gen)
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 269, in transaction
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     yield t
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/lib64/python3.6/contextlib.py", line 88, in __exit__
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     next(self.gen)
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/api.py", line 110, in transaction
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     del self._nested_txns_map[cur_thread_id]
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/api.py", line 61, in __exit__
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     self.result = self.commit()
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     raise result.ex
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 118, in run
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     txn.results.put(txn.do_commit())
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin   File "/usr/local/lib/python3.6/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin     raise RuntimeError(msg)
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin RuntimeError: OVSDB Error: {"details":"Table Logical_Router column static_routes row f4e61e8d-2225-4aa3-a42a-1dd9b0b219ea references nonexistent row 3652a4cb-7fac-4811-a4cc-d812a6d81c3d in table Logical_Router_Static_Route.","error":"referential integrity violation"}
  2024-07-16 16:11:37.652 146 ERROR neutron.services.ovn_l3.plugin ^[[00m

  neutron version: wallaby

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2073326/+subscriptions
Follow ups

[Bug 2073326] Re: [ovn] OVSDB Error ' references nonexistent' occurs when updating one router.
From: Rodolfo Alonso, 2024-07-23