yahoo-eng-team team mailing list archive

[Tushar Patil <1367944@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

I have noticed that when a tenant usage information API is invoked for a
particular tenant owning large number of instances (both active &
terminated), then I see a sudden increase in nova-api process memory
consumption from 500 MB up to 2.3 GB.

It is due to a SQL retrieving large number of records of
instance_system_metadata for instances using where in clause.

At the time of getting tenant usage information, I had approx. 120,000
instances in the db for a particular tenant (few were active and
remaining terminated)

Also in this plugin, it unnecessarily  gets following information of the instances from the db further degrading the performance of the API.
1. metadata
2. info_cache
3. security_groups

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: ntt

** Tags added: ntt

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1367944

Title:
  tenant usage information api is consuming lot of memory

Status in OpenStack Compute (Nova):
  New

Bug description:
  I have noticed that when a tenant usage information API is invoked for
  a particular tenant owning large number of instances (both active &
  terminated), then I see a sudden increase in nova-api process memory
  consumption from 500 MB up to 2.3 GB.

  It is due to a SQL retrieving large number of records of
  instance_system_metadata for instances using where in clause.

  At the time of getting tenant usage information, I had approx. 120,000
  instances in the db for a particular tenant (few were active and
  remaining terminated)

  Also in this plugin, it unnecessarily  gets following information of the instances from the db further degrading the performance of the API.
  1. metadata
  2. info_cache
  3. security_groups

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1367944/+subscriptions