yahoo-eng-team team mailing list archive

[Ann Taraday <akamyshnikova@xxxxxxxxxxxx>]

Public bug reported:

Scale environment 3 controllers, 45 computes Mitaka, L3 HA 
After running rally test create_and_delete_routers agent logs are full of errors http://paste.openstack.org/show/525987/ and on server side http://paste.openstack.org/show/525175/.

The root cause of this issue seems that deletion of router is not
isolated properly, HA ports are deleted concurrently, so we have HA
router proceed, although HA interfaces are deleted.

In logs we can see "Got router deleted notification for <id>
router_deleted" and after that still some actions with that router,
warning "Info for router <id> was not found. Performing router cleanup"
and after that "Got routers updated notification :[u'<id>']
routers_updated", all this caused infinitive loop for deleting routers
until l3-agent restarted.


Logs -
https://drive.google.com/a/mirantis.com/folderview?id=0By7EBG7Kg4gHXzJpRUNiS1MzU2M&usp=sharing#

** Affects: neutron
     Importance: Undecided
     Assignee: Ann Taraday (akamyshnikova)
         Status: New


** Tags: l3-ha

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1605546

Title:
  Race with deleting HA routers

Status in neutron:
  New

Bug description:
  Scale environment 3 controllers, 45 computes Mitaka, L3 HA 
  After running rally test create_and_delete_routers agent logs are full of errors http://paste.openstack.org/show/525987/ and on server side http://paste.openstack.org/show/525175/.

  The root cause of this issue seems that deletion of router is not
  isolated properly, HA ports are deleted concurrently, so we have HA
  router proceed, although HA interfaces are deleted.

  In logs we can see "Got router deleted notification for <id>
  router_deleted" and after that still some actions with that router,
  warning "Info for router <id> was not found. Performing router
  cleanup" and after that "Got routers updated notification :[u'<id>']
  routers_updated", all this caused infinitive loop for deleting routers
  until l3-agent restarted.


  Logs -
  https://drive.google.com/a/mirantis.com/folderview?id=0By7EBG7Kg4gHXzJpRUNiS1MzU2M&usp=sharing#

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1605546/+subscriptions