yahoo-eng-team team mailing list archive

[Matthias Runge <1247056@xxxxxxxxxxxxxxxxxx>]

** Also affects: python-novaclient
   Importance: Undecided
       Status: New

** Changed in: python-novaclient
       Status: New => In Progress

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Dashboard (Horizon).
https://bugs.launchpad.net/bugs/1247056

Title:
  Too many connections to nova-api (and not cleaning up)?

Status in OpenStack Dashboard (Horizon):
  In Progress
Status in Python client library for Nova:
  In Progress

Bug description:
  We hit this bug while doing a tripleo/tuskar provision against 7
  baremetal machines. Basically after everything was up and running for
  a while, whilst using the Horizon UI to view the active instances (the
  7 baremetal machines that were provisioned as nova compute nodes)
  Horizon threw an error complaining about too may open files.

  
  [stack@ucl-control-live ~]$ sudo lsof -i :8774 | wc -l                        
  2073                                                                          

  Restarting openstack-nova-api closed them all  (put them all into
  FIN_WAIT2 / CLOSE_WAIT.)

  I was able to recreate this on a more 'standard' setup with devstack.
  To recreate:

  1. Run devstack
  2. Monitor connections to nova-api in a terminal: while true; sudo lsof -i :8774; date; sleep 2; done         
     At this point for me the output here was steady at 10.

  3. Log into Horizon and Launch an instance, or two.
  4. In Horizon, alternate between "Project-->Overview" and "Project-->Instances"
  5. Watch the output from lsof. In a short time I got this up to 150+. Leaving it idle (doing nothing more anywhere), the connections hang around (i.e. all in ESTABLISHED state). In fact they hang around even after I log out of Horizon.

  Is this expected behaviour?

  thanks, marios

To manage notifications about this bug go to:
https://bugs.launchpad.net/horizon/+bug/1247056/+subscriptions