yahoo-eng-team team mailing list archive

[Assaf Muller <amuller@xxxxxxxxxx>]

Public bug reported:

Full stack tests uses AsyncProcess to manage agents. When tearing down
the test environment it issues kill -9, stopping the agent dead,
sometimes before it's had time to clean up resources. Specifically in
fullstack/test_l3_agent.TestLegacyL3Agent.test_namespace_exists, the
router is deleted at the end of the test and the test is concluded.
Sometimes the router deletion RPC message is read by the agent in time,
sometime it isn't. When it is, the agent might not finish cleaning up
the router in time, leaving behind resources such as the namespace,
metadata proxy process, etc.

For example, here's the last line in one run of the l3 test agent during the test:
2015-05-07 18:42:03.444 12337 DEBUG neutron.agent.l3.agent [req-e22bbdee-96b2-46b1-a995-ac74f4cc32d3 - - - - -] Got router deleted notification for 17cf2d41-a7e2-4c16-a50e-a2c917b2a61f router_deleted /opt/openstack/neutron/neutron/agent/l3/agent.py:358

** Affects: neutron
     Importance: Medium
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1452935

Title:
  Full stack tests leave agent resources behind

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  Full stack tests uses AsyncProcess to manage agents. When tearing down
  the test environment it issues kill -9, stopping the agent dead,
  sometimes before it's had time to clean up resources. Specifically in
  fullstack/test_l3_agent.TestLegacyL3Agent.test_namespace_exists, the
  router is deleted at the end of the test and the test is concluded.
  Sometimes the router deletion RPC message is read by the agent in
  time, sometime it isn't. When it is, the agent might not finish
  cleaning up the router in time, leaving behind resources such as the
  namespace, metadata proxy process, etc.

  For example, here's the last line in one run of the l3 test agent during the test:
  2015-05-07 18:42:03.444 12337 DEBUG neutron.agent.l3.agent [req-e22bbdee-96b2-46b1-a995-ac74f4cc32d3 - - - - -] Got router deleted notification for 17cf2d41-a7e2-4c16-a50e-a2c917b2a61f router_deleted /opt/openstack/neutron/neutron/agent/l3/agent.py:358

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1452935/+subscriptions