yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #69833
[Bug 1731595] Re: L3 HA: multiple agents are active at the same time
Hi Xav,
I took a look at the code and confirmed that this does appear to affect
Newton and Mitaka so I've targeted those releases as well. We'll need to
backport the Ocata patches to Newton and then Mitaka.
Corey
** Also affects: neutron (Ubuntu Xenial)
Importance: Undecided
Status: New
** Changed in: neutron (Ubuntu Xenial)
Importance: Undecided => High
** Changed in: neutron (Ubuntu Xenial)
Status: New => Triaged
** Also affects: cloud-archive/mitaka
Importance: Undecided
Status: New
** Also affects: cloud-archive/newton
Importance: Undecided
Status: New
** Changed in: cloud-archive/newton
Importance: Undecided => High
** Changed in: cloud-archive/newton
Status: New => Triaged
** Changed in: cloud-archive/mitaka
Importance: Undecided => High
** Changed in: cloud-archive/mitaka
Status: New => Triaged
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1731595
Title:
L3 HA: multiple agents are active at the same time
Status in Ubuntu Cloud Archive:
Fix Released
Status in Ubuntu Cloud Archive mitaka series:
Triaged
Status in Ubuntu Cloud Archive newton series:
Triaged
Status in Ubuntu Cloud Archive ocata series:
Fix Committed
Status in Ubuntu Cloud Archive pike series:
Fix Committed
Status in Ubuntu Cloud Archive queens series:
Fix Released
Status in neutron:
Fix Released
Status in neutron package in Ubuntu:
Fix Released
Status in neutron source package in Xenial:
Triaged
Status in neutron source package in Zesty:
Fix Committed
Status in neutron source package in Artful:
Fix Committed
Status in neutron source package in Bionic:
Fix Released
Bug description:
OS: Xenial, Ocata from Ubuntu Cloud Archive
We have three neutron-gateway hosts, with L3 HA enabled and a min of 2, max of 3. There are approx. 400 routers defined.
At some point (we weren't monitoring exactly) a number of the routers
changed from being one active, and 1+ others standby, to >1 active.
This included each of the 'active' namespaces having the same IP
addresses allocated, and therefore traffic problems reaching
instances.
Removing the routers from all but one agent, and re-adding, resolved
the issue. Restarting one l3 agent also appeared to resolve the
issue, but very slowly, to the point where we needed the system alive
again faster and reverted to removing/re-adding.
At the same time, a number of routers were listed without any agents
active at all. This situation appears to have been resolved by adding
routers to agents, after several minutes downtime.
I'm finding it very difficult to find relevant keepalived messages to
indicate what's going on, but what I do notice is that all the agents
have equal priority and are configured as 'backup'.
I am trying to figure out a way to get a reproducer of this, it might
be that we need to have a large number of routers configured on a
small number of gateways.
To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-archive/+bug/1731595/+subscriptions
References