yahoo-eng-team team mailing list archive

[OpenStack Infra <1989480@xxxxxxxxxxxxxxxxxx>]

Reviewed:  https://review.opendev.org/c/openstack/neutron/+/857463
Committed: https://opendev.org/openstack/neutron/commit/9655466763282f47a06862a47f7f31b48130277e
Submitter: "Zuul (22348)"
Branch:    master

commit 9655466763282f47a06862a47f7f31b48130277e
Author: Lucas Alvares Gomes <lucasagomes@xxxxxxxxx>
Date:   Tue Sep 13 16:11:37 2022 +0100

    [OVN] Rate limit the "Disallow caching" log from hash ring
    
    This patch adds a condition prior to logging the "Disallow caching" log
    message from the hash ring.
    
    Prior to this patch, this message was logged when the number of nodes
    connected to the hash ring was different from the number of API workers
    at Neutron's startup. This is because the hash ring waits until all API
    workers are connected to build the hash ring cache.
    
    With this patch, we will only log the message once (per worker) until
    the number of connected nodes changes. When nodes connect and the cache
    is built the _wait_startup_before_caching() is no longer used until the
    service is restarted again.
    
    Change-Id: I4f62b723083215483a2277cfcb798506671e1a2d
    Closes-Bug: 1989480
    Signed-off-by: Lucas Alvares Gomes <lucasagomes@xxxxxxxxx>


** Changed in: neutron
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1989480

Title:
  [OVN] Neutron server floods logs with hash ring messages on startup

Status in neutron:
  Fix Released

Bug description:
  Reported at: https://bugzilla.redhat.com/show_bug.cgi?id=2125828

  Neutron server issues over 300 messages per second during startup with
  debug on:

  2022-09-10 21:55:32.998 55 DEBUG
  networking_ovn.common.hash_ring_manager [-] Disallow caching, nodes
  0<26 _wait_startup_before_caching /usr/lib/python3.6/site-
  packages/networking_ovn/common/hash_ring_manager.py:61

  This message is logged when the number of nodes in the hash ring is
  different than the number of API workers at Neutron's startup. The
  hash ring waits until all API workers are connected to OVSDB prior to
  building the hash ring cache.

  We need to rate limit this message, in case there are problems with
  the API workers not being able to connected to OVSDB this message does
  not spam the Neutron logs.

  The message itself is still useful IMHO, for knowing that the hash
  ring cache is not yet built.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1989480/+subscriptions