← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1157437] Re: euca-describe-instances is not optimized and takes 38 seconds for 700 VMs

 

Reviewed:  https://review.openstack.org/25399
Committed: http://github.com/openstack/nova/commit/e54700528a1cb3ead26eb0f2d1c1d0932885f07e
Submitter: Jenkins
Branch:    milestone-proposed

commit e54700528a1cb3ead26eb0f2d1c1d0932885f07e
Author: Vishvananda Ishaya <vishvananda@xxxxxxxxx>
Date:   Tue Mar 19 17:56:30 2013 -0700

    Add caching for ec2 mapping ids.
    
    Requests to map ec2 ids can be slow when there are a large number
    of instances. These shouldn't ever change so cache them in memory
    for a week. The one week timeout is simply to prevent memory from
    growing uncontrollably.
    
    Fixes bug 1157437
    
    Change-Id: I3f1c68959a933a7aaa50f122c34a716264c8722d
    (cherry picked from commit 76844433f69a7c29ed4566ad34d7e9740feaf660)


** Changed in: nova
       Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1157437

Title:
  euca-describe-instances  is not optimized and takes 38 seconds for 700
  VMs

Status in OpenStack Compute (Nova):
  Fix Released

Bug description:
  using Devstack (Grizzly-3) and nova  SHA1
  98f9f735d7e6ac32a8736971f4aab0d81c56131e

  and running as admin user.

  euca-describe-instances (POST /services/Cloud/
  CloudController:DescribeInstances)  is 13 times slower than nova list
  with 700 VMS.

  This is because s3_image_get_by_uuid is called three times per
  instance and

  block_device_mapping_get_all_by_instance,
  block_device_mapping_get_all_by_instance,
  aggregate_metadata_get_by_host,
  get_ec2_instance_id_by_uuid

  are called once per hose.

  So for 700 VMs that is  4900 DB calls!

  In comparison 'nova list' does 2 DB calls no matter how many VMs there
  are.

  
  When running the same thing as demo user I get the same thing

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1157437/+subscriptions