← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1990174] Re: [OVN] Deadlock when starting neutron server, during the OVN hash ring deletion

 

Reviewed:  https://review.opendev.org/c/openstack/neutron/+/860934
Committed: https://opendev.org/openstack/neutron/commit/b7b8f7c571440577a40aacf9d8d93abc3a5a48b3
Submitter: "Zuul (22348)"
Branch:    master

commit b7b8f7c571440577a40aacf9d8d93abc3a5a48b3
Author: Lucas Alvares Gomes <lucasagomes@xxxxxxxxx>
Date:   Tue Oct 11 11:08:23 2022 +0100

    [OVN] Avoid deadlock when cleaning hash ring nodes
    
    This patch avoids the clash of the hash ring cleaning operation and the
    API workers by ensuring that the cleaning happens before the nodes for
    that host are added to the ring and the connections to the OVSDBs (meaning
    no events therefore no SELECTS on the hash ring table for that hostname).
    
    This patch does this by re-using the same hash ring lock that starts
    the probing thread. Now, the first worker that acquire the lock is
    responsible for cleaning the hash ring for it's own host as well as
    starting the probing thread. Subsequently workers only need to register
    themselves to the hash ring.
    
    Change-Id: Iba73f7944592a003232eb397ba1d4da3dcba5c3a
    Closes-Bug: #1990174
    Signed-off-by: Lucas Alvares Gomes <lucasagomes@xxxxxxxxx>


** Changed in: neutron
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1990174

Title:
  [OVN] Deadlock when starting neutron server, during the OVN hash ring
  deletion

Status in neutron:
  Fix Released

Bug description:
  Related bugzilla: https://bugzilla.redhat.com/show_bug.cgi?id=2125842

  Description of problem:
  Neutron server often fails to start and systemd needs to restart it. This is a problem at scale because all workers need to reconnect again to the OVN DBs.

  How reproducible:
  50%

  Steps to Reproduce:
  1. Start neutron server

  
  Error log: https://paste.opendev.org/show/bm3jZZ1oWX7ihK8JXzdE/

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1990174/+subscriptions



References