yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #89856
[Bug 1990174] Re: [OVN] Deadlock when starting neutron server, during the OVN hash ring deletion
Reviewed: https://review.opendev.org/c/openstack/neutron/+/860934
Committed: https://opendev.org/openstack/neutron/commit/b7b8f7c571440577a40aacf9d8d93abc3a5a48b3
Submitter: "Zuul (22348)"
Branch: master
commit b7b8f7c571440577a40aacf9d8d93abc3a5a48b3
Author: Lucas Alvares Gomes <lucasagomes@xxxxxxxxx>
Date: Tue Oct 11 11:08:23 2022 +0100
[OVN] Avoid deadlock when cleaning hash ring nodes
This patch avoids the clash of the hash ring cleaning operation and the
API workers by ensuring that the cleaning happens before the nodes for
that host are added to the ring and the connections to the OVSDBs (meaning
no events therefore no SELECTS on the hash ring table for that hostname).
This patch does this by re-using the same hash ring lock that starts
the probing thread. Now, the first worker that acquire the lock is
responsible for cleaning the hash ring for it's own host as well as
starting the probing thread. Subsequently workers only need to register
themselves to the hash ring.
Change-Id: Iba73f7944592a003232eb397ba1d4da3dcba5c3a
Closes-Bug: #1990174
Signed-off-by: Lucas Alvares Gomes <lucasagomes@xxxxxxxxx>
** Changed in: neutron
Status: In Progress => Fix Released
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1990174
Title:
[OVN] Deadlock when starting neutron server, during the OVN hash ring
deletion
Status in neutron:
Fix Released
Bug description:
Related bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=2125842
Description of problem:
Neutron server often fails to start and systemd needs to restart it. This is a problem at scale because all workers need to reconnect again to the OVN DBs.
How reproducible:
50%
Steps to Reproduce:
1. Start neutron server
Error log: https://paste.opendev.org/show/bm3jZZ1oWX7ihK8JXzdE/
To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1990174/+subscriptions
References