yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1999392] [NEW] Some events which are supposed to be run AFTER changes are commited are performed BEFORE commit

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Slawek Kaplonski <1999392@xxxxxxxxxxxxxxxxxx>
Date: Mon, 12 Dec 2022 11:18:05 -0000
Reply-to: Bug 1999392 <1999392@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:

I noticed such warnings in neutron-server logs in CI jobs. Example of
stacktrace:

Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: WARNING neutron.plugins.ml2.ovo_rpc [None req-8e39b39c-bbd4-4a17-84e8-f376b4857023 tempest-L3AgentSchedulerTestJSON-1326864497 tempest-L3AgentSchedulerTestJSON-1326864497-project] This handler is supposed to handle AFTER events, as in 'AFTER it's committed', not BEFORE. Offending resource event: port, after_delete. Location:
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/greenthread.py", line 221, in main
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     result = function(*args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 837, in process_request
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     proto.__init__(conn_state, self)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 350, in __init__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self.handle()
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 383, in handle
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self.handle_one_request()
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 459, in handle_one_request
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self.handle_one_response()
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 569, in handle_one_response
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     result = self.application(self.environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/paste/urlmap.py", line 216, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return app(environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/base.py", line 124, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self.application)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/base.py", line 124, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self.application)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/request_id.py", line 58, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self.application)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/catch_errors.py", line 40, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self.application)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/osprofiler/web.py", line 111, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return request.get_response(self.application)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self._app)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return resp(environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return resp(environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/routes/middleware.py", line 153, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = self.app(environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return resp(environ, start_response)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/api/v2/resource.py", line 98, in resource
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     result = method(request=request, **args)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/api/v2/base.py", line 575, in delete
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self._delete(request, id, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 138, in wrapped
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_db/api.py", line 142, in wrapper
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 184, in wrapped
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*dup_args, **dup_kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/api/v2/base.py", line 603, in _delete
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     obj_deleter(request.context, id, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/db/l3_db.py", line 2187, in delete_router
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     super(L3_NAT_db_mixin, self).delete_router(context, id)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 226, in wrapped
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f_with_retry(*args, **kwargs,
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 138, in wrapped
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_db/api.py", line 142, in wrapper
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 184, in wrapped
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*dup_args, **dup_kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/db/l3_db.py", line 623, in delete_router
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self._core_plugin.delete_port(context.elevated(), rp_id,
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/common/utils.py", line 707, in inner
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 224, in wrapped
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 2158, in delete_port
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self._post_delete_port(
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 2163, in _post_delete_port
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     registry.publish(resources.PORT, events.AFTER_DELETE, self,
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/registry.py", line 54, in publish
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     _get_callback_manager().publish(resource, event, trigger, payload=payload)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/utils.py", line 104, in _wrapped
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return function(*args, **kwargs)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/manager.py", line 150, in publish
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     errors = self._notify_loop(resource, event, trigger, payload)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     callback(resource, event, trigger, payload=payload)
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py", line 100, in handle_event
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     if self._is_session_semantic_violated(
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py", line 84, in _is_session_semantic_violated
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     stack = traceback.extract_stack()
Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: 


Link: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d8f/860270/8/check/neutron-tempest-plugin-openvswitch/d8f61ec/controller/logs/screen-q-svc.txt

But it happens in many CI jobs really.
Fortunately it don't cause CI failures but we should fix it.

** Affects: neutron
     Importance: Medium
     Assignee: Rodolfo Alonso (rodolfo-alonso-hernandez)
         Status: Confirmed


** Tags: db

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1999392

Title:
  Some events which are supposed to be run AFTER changes are commited
  are performed BEFORE commit

Status in neutron:
  Confirmed

Bug description:
  I noticed such warnings in neutron-server logs in CI jobs. Example of
  stacktrace:

  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: WARNING neutron.plugins.ml2.ovo_rpc [None req-8e39b39c-bbd4-4a17-84e8-f376b4857023 tempest-L3AgentSchedulerTestJSON-1326864497 tempest-L3AgentSchedulerTestJSON-1326864497-project] This handler is supposed to handle AFTER events, as in 'AFTER it's committed', not BEFORE. Offending resource event: port, after_delete. Location:
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/greenthread.py", line 221, in main
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     result = function(*args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 837, in process_request
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     proto.__init__(conn_state, self)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 350, in __init__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self.handle()
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 383, in handle
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self.handle_one_request()
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 459, in handle_one_request
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self.handle_one_response()
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/eventlet/wsgi.py", line 569, in handle_one_response
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     result = self.application(self.environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/paste/urlmap.py", line 216, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return app(environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/base.py", line 124, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self.application)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/base.py", line 124, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self.application)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/request_id.py", line 58, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self.application)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_middleware/catch_errors.py", line 40, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self.application)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/osprofiler/web.py", line 111, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return request.get_response(self.application)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/keystonemiddleware/auth_token/__init__.py", line 341, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = req.get_response(self._app)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1313, in send
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     status, headers, app_iter = self.call_application(
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/request.py", line 1278, in call_application
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     app_iter = application(self.environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return resp(environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return resp(environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/routes/middleware.py", line 153, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     response = self.app(environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 143, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return resp(environ, start_response)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 129, in __call__
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     resp = self.call_func(req, *args, **kw)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/webob/dec.py", line 193, in call_func
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self.func(req, *args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/api/v2/resource.py", line 98, in resource
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     result = method(request=request, **args)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/api/v2/base.py", line 575, in delete
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return self._delete(request, id, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 138, in wrapped
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_db/api.py", line 142, in wrapper
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 184, in wrapped
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*dup_args, **dup_kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/api/v2/base.py", line 603, in _delete
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     obj_deleter(request.context, id, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/db/l3_db.py", line 2187, in delete_router
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     super(L3_NAT_db_mixin, self).delete_router(context, id)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 226, in wrapped
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f_with_retry(*args, **kwargs,
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 138, in wrapped
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/oslo_db/api.py", line 142, in wrapper
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 184, in wrapped
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*dup_args, **dup_kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/db/l3_db.py", line 623, in delete_router
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self._core_plugin.delete_port(context.elevated(), rp_id,
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/common/utils.py", line 707, in inner
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/api.py", line 224, in wrapped
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return f(*args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 2158, in delete_port
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     self._post_delete_port(
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/plugins/ml2/plugin.py", line 2163, in _post_delete_port
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     registry.publish(resources.PORT, events.AFTER_DELETE, self,
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/registry.py", line 54, in publish
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     _get_callback_manager().publish(resource, event, trigger, payload=payload)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/db/utils.py", line 104, in _wrapped
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     return function(*args, **kwargs)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/manager.py", line 150, in publish
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     errors = self._notify_loop(resource, event, trigger, payload)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/usr/local/lib/python3.10/dist-packages/neutron_lib/callbacks/manager.py", line 181, in _notify_loop
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     callback(resource, event, trigger, payload=payload)
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py", line 100, in handle_event
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     if self._is_session_semantic_violated(
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:   File "/opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py", line 84, in _is_session_semantic_violated
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]:     stack = traceback.extract_stack()
  Dec 12 09:40:26.777271 nested-virt-ubuntu-jammy-ovh-bhs1-0032473968 neutron-server[56690]: 

  
  Link: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d8f/860270/8/check/neutron-tempest-plugin-openvswitch/d8f61ec/controller/logs/screen-q-svc.txt

  But it happens in many CI jobs really.
  Fortunately it don't cause CI failures but we should fix it.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1999392/+subscriptions