yahoo-eng-team team mailing list archive

[Sean Dague <sean@xxxxxxxxx>]

Believe this is fixed old incomplete bug should be invalid

** Changed in: nova
       Status: Incomplete => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1176446

Title:
  nova list as admin is slow (no vms)

Status in OpenStack Compute (Nova):
  Invalid

Bug description:
  Running nova 2013.1 from Ubuntu packages.

  I saw bug 1160487 and thought this  might be a dup but I dont believe
  so because running nova list as admin who owns no VMs at all takes
  about 25-30 seconds to return .

  We also applied commit e653938ff7bc6b9b3e97e784bb07516576305b3e to
  nova which significantly improved nova list for none admin tenants
  only.

  nova --debug list

  EQ: curl -i http://10.34.104.187:35357/v2.0/tokens -X POST -H
  "Content-Type: application/json" -H "Accept: application/json" -H
  "User-Agent: python-novaclient" -d '{"auth": {"tenantName": "nicira",
  "passwordCredentials": {"username": "admin", "password": "xxxxx!"}}}'

  INFO (connectionpool:191) Starting new HTTP connection (1): 10.34.104.187
  DEBUG (connectionpool:283) "POST /v2.0/tokens HTTP/1.1" 200 2416
  RESP: [200] {'date': 'Sat, 04 May 2013 23:32:29 GMT', 'content-type': 'application/json', 'content-length': '2416', 'vary': 'X-Auth-Token'}
  RESP BODY: {"access": {"token": {"issued_at": "2013-05-04T23:32:29.848568", "expires": "2013-05-05T23:32:29Z", "id": "166650472b6e4bc0bd0ec3c1ab82a2e2", "tenant": {"description": "Default Tenant - Admin", "enabled": true, "id": "fc9ba4c1d32d48679b5c3e9b2c004b9b", "name": "nicira"}}, "serviceCatalog": [{"endpoints": [{"adminURL": "http://10.34.104.185:8774/v2/fc9ba4c1d32d48679b5c3e9b2c004b9b";, "region": "PA", "internalURL": "http://10.34.104.185:8774/v2/fc9ba4c1d32d48679b5c3e9b2c004b9b";, "id": "280c800402da47d393e4e0890a5a830e", "publicURL": "http://10.34.104.185:8774/v2/fc9ba4c1d32d48679b5c3e9b2c004b9b"}], "endpoints_links": [], "type": "compute", "name": "nova"}, {"endpoints": [{"adminURL": "http://10.34.104.188:9696";, "region": "PA", "internalURL": "http://10.34.104.188:9696";, "id": "2b188ab59755429c94324088bb2fa9a2", "publicURL": "http://10.34.104.188:9696"}], "endpoints_links": [], "type": "network", "name": "quantum"}, {"endpoints": [{"adminURL": "http://10.34.104.185:9292";, "region": "PA", "internalURL": "http://10.34.104.185:9292";, "id": "be1d2f2449ac448299c1258913b16474", "publicURL": "http://10.34.104.185:9292"}], "endpoints_links": [], "type": "image", "name": "glance"}, {"endpoints": [{"adminURL": "http://10.34.104.190:8776/v1/fc9ba4c1d32d48679b5c3e9b2c004b9b";, "region": "PA", "internalURL": "http://10.34.104.190:8776/v1/fc9ba4c1d32d48679b5c3e9b2c004b9b";, "id": "9ae35a87f24040038851ce9c9e20147d", "publicURL": "http://10.34.104.190:8776/v1/fc9ba4c1d32d48679b5c3e9b2c004b9b"}], "endpoints_links": [], "type": "volume", "name": "cinder"}, {"endpoints": [{"adminURL": "http://10.34.104.185:8773/service/Cloud";, "region": "PA", "internalURL": "http://10.34.104.185:8773/service/Cloud";, "id": "0ae37a0217d6445e8adbb5ce08146c0b", "publicURL": "http://10.34.104.185:8773/service/Cloud"}], "endpoints_links": [], "type": "ec2", "name": "ec2"}, {"endpoints": [{"adminURL": "http://10.34.104.187:35357/v2.0";, "region": "PA", "internalURL": "http://10.34.104.187:5000/v2.0";, "id": "37b3aa6fade24ced8d6dae8fdaac8449", "publicURL": "http://10.34.104.187:5000/v2.0"}], "endpoints_links": [], "type": "identity", "name": "keystone"}], "user": {"username": "admin", "roles_links": [], "id": "5e363b8f0665443d89ca9d9787a19a81", "roles": [{"name": "admin"}, {"name": "_member_"}], "name": "admin"}, "metadata": {"is_admin": 0, "roles": ["b04ac30a90f64c3692d54c73e924e2ae", "9fe2ff9ee4384b1894a90878d3e92bab"]}}}

  
  REQ: curl -i http://10.34.104.185:8774/v2/fc9ba4c1d32d48679b5c3e9b2c004b9b/servers/detail -X GET -H "X-Auth-Project-Id: nicira" -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: 166650472b6e4bc0bd0ec3c1ab82a2e2"

  INFO (connectionpool:191) Starting new HTTP connection (1): 10.34.104.185
  DEBUG (connectionpool:283) "GET /v2/fc9ba4c1d32d48679b5c3e9b2c004b9b/servers/detail HTTP/1.1" 200 15
  RESP: [200] {'date': 'Sat, 04 May 2013 23:33:06 GMT', 'x-compute-request-id': 'req-32739176-1998-4b1e-8fa6-c2f7b029b6a7', 'content-type': 'application/json', 'content-length': '15'}
  RESP BODY: {"servers": []}

  nova-api logs in debug mode:

  
  2013-05-04 16:32:40.958 8633 INFO nova.osapi_compute.wsgi.server [-] (8633) accepted ('10.34.104.185', 58359)

  2013-05-04 16:32:41.080 DEBUG nova.api.openstack.wsgi [req-32739176-1998-4b1e-8fa6-c2f7b029b6a7 5e363b8f0665443d89ca9d9787a19a81 fc9ba4c1d32d48679b5c3e9b2c004b9b] No Content-Type provided in request get_body /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:791
  2013-05-04 16:32:41.080 DEBUG nova.api.openstack.wsgi [req-32739176-1998-4b1e-8fa6-c2f7b029b6a7 5e363b8f0665443d89ca9d9787a19a81 fc9ba4c1d32d48679b5c3e9b2c004b9b] Calling method <bound method Controller.detail of <nova.api.openstack.compute.servers.Controller object at 0x2ed9f90>> _process_stack /usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py:911
  2013-05-04 16:32:41.081 DEBUG nova.compute.api [req-32739176-1998-4b1e-8fa6-c2f7b029b6a7 5e363b8f0665443d89ca9d9787a19a81 fc9ba4c1d32d48679b5c3e9b2c004b9b] Searching by: {'deleted': False, 'project_id': u'fc9ba4c1d32d48679b5c3e9b2c004b9b'} get_all /usr/lib/python2.7/dist-packages/nova/compute/api.py:1372

  2013-05-04 16:33:06.487 INFO nova.osapi_compute.wsgi.server
  [req-32739176-1998-4b1e-8fa6-c2f7b029b6a7
  5e363b8f0665443d89ca9d9787a19a81 fc9ba4c1d32d48679b5c3e9b2c004b9b]
  10.34.104.185 "GET /v2/fc9ba4c1d32d48679b5c3e9b2c004b9b/servers/detail
  HTTP/1.1" status: 200 len: 187 time: 25.5273259

  Clearly no instances are returned because there are none and it took
  (16:32:40 - 16:33:06) 26 seconds.

  The same slowness can be observed if you run nova show on any
  instance.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1176446/+subscriptions