← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1657423] [NEW] Instances view in Dashboard spawns "Error: Unable to retrieve instance list."

 

Public bug reported:

I'm running Mitaka on Ubuntu 16.04 and when I try to access Instances
list in Dashboard, the following is error is spawned: Error: Unable to
retrieve instance list. Same error is spawned for all users.

Same thing happens in CLI:
nova list --all-tenants
ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-30134c69-6c89-4437-9fd7-a2ca7b169ed7)

Debug output of the same command from above:
nova --debug list --all-tenants
DEBUG (extension:157) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
DEBUG (extension:157) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode')
DEBUG (extension:157) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword')
DEBUG (extension:157) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
DEBUG (extension:157) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
DEBUG (extension:157) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
DEBUG (session:248) REQ: curl -g -i -X GET http://10.0.0.1:35357/v3 -H "Accept: application/json" -H "User-Agent: keystoneauth1/2.4.1 python-requests/2.9.1 CPython/2.7.12"
INFO (connectionpool:208) Starting new HTTP connection (1): 10.0.0.1
DEBUG (connectionpool:388) "GET /v3 HTTP/1.1" 200 248
DEBUG (session:277) RESP: [200] Content-Length: 248 Vary: X-Auth-Token Server: Apache/2.4.18 (Ubuntu) Date: Wed, 18 Jan 2017 11:25:28 GMT x-openstack-request-id: req-43f828d7-4919-4d24-acbf-513c1b7fa496 Content-Type: application/json X-Distribution: Ubuntu 
RESP BODY: {"version": {"status": "stable", "updated": "2016-04-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.6", "links": [{"href": "http://10.0.0.1:35357/v3/";, "rel": "self"}]}}

DEBUG (base:165) Making authentication request to http://10.0.0.1:35357/v3/auth/tokens
DEBUG (connectionpool:388) "POST /v3/auth/tokens HTTP/1.1" 201 7476
DEBUG (session:248) REQ: curl -g -i -X GET http://10.0.0.1:8774/v2.1/b77576d7ea0c45a3a24a8da20dbe983e -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}c3bd40d9088aa0e9755d065fa91cea9d5736b361"
INFO (connectionpool:208) Starting new HTTP connection (1): 10.0.0.1
DEBUG (connectionpool:388) "GET /v2.1/b77576d7ea0c45a3a24a8da20dbe983e HTTP/1.1" 404 52
DEBUG (session:277) RESP: [404] Date: Wed, 18 Jan 2017 11:25:33 GMT Content-Length: 52 Content-Type: text/plain; charset=UTF-8 X-Compute-Request-Id: req-06891843-9fe6-432f-b038-2191efd401b0 
RESP BODY: 404 Not Found

The resource could not be found.


DEBUG (session:248) REQ: curl -g -i -X GET http://10.0.0.1:8774/v2.1/ -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}c3bd40d9088aa0e9755d065fa91cea9d5736b361"
DEBUG (connectionpool:388) "GET /v2.1/ HTTP/1.1" 200 382
DEBUG (session:277) RESP: [200] Content-Length: 382 X-Compute-Request-Id: req-732fd6ce-57b0-4858-9740-4bbd9899de6a Vary: X-OpenStack-Nova-API-Version X-Openstack-Nova-Api-Version: 2.1 Date: Wed, 18 Jan 2017 11:25:33 GMT Content-Type: application/json 
RESP BODY: {"version": {"status": "CURRENT", "updated": "2013-07-23T11:33:21Z", "links": [{"href": "http://10.0.0.1:8774/v2.1/";, "rel": "self"}, {"href": "http://docs.openstack.org/";, "type": "text/html", "rel": "describedby"}], "min_version": "2.1", "version": "2.25", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.compute+json;version=2.1"}], "id": "v2.1"}}

DEBUG (extension:157) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
DEBUG (extension:157) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode')
DEBUG (extension:157) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
DEBUG (extension:157) found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword')
DEBUG (extension:157) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
DEBUG (extension:157) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
DEBUG (extension:157) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
DEBUG (session:248) REQ: curl -g -i -X GET http://10.0.0.1:8774/v2.1/b77576d7ea0c45a3a24a8da20dbe983e/servers/detail?all_tenants=1 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-OpenStack-Nova-API-Version: 2.25" -H "X-Auth-Token: {SHA1}c3bd40d9088aa0e9755d065fa91cea9d5736b361"
DEBUG (connectionpool:388) "GET /v2.1/b77576d7ea0c45a3a24a8da20dbe983e/servers/detail?all_tenants=1 HTTP/1.1" 500 193
DEBUG (session:277) RESP: [500] Content-Length: 193 X-Compute-Request-Id: req-071a25d2-3d7d-4d53-b2a5-d33643a39570 Vary: X-OpenStack-Nova-API-Version X-Openstack-Nova-Api-Version: 2.25 Date: Wed, 18 Jan 2017 11:25:33 GMT Content-Type: application/json; charset=UTF-8 
RESP BODY: {"computeFault": {"message": "Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.\n<type 'exceptions.TypeError'>", "code": 500}}

DEBUG (shell:1082) Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-071a25d2-3d7d-4d53-b2a5-d33643a39570)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 1080, in main
    OpenStackComputeShell().main(argv)
  File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 1007, in main
    args.func(self.cs, args)
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/shell.py", line 1513, in do_list
    limit=args.limit)
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 749, in list
    "servers")
  File "/usr/lib/python2.7/dist-packages/novaclient/base.py", line 242, in _list
    resp, body = self.api.client.get(url)
  File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 173, in get
    return self.request(url, 'GET', **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 94, in request
    raise exceptions.from_response(resp, body, url, method)
ClientException: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-071a25d2-3d7d-4d53-b2a5-d33643a39570)
ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-071a25d2-3d7d-4d53-b2a5-d33643a39570)

Following is the nova-api log with relevant info:

2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions [req-e4be7ec8-1e0f-43ed-a576-099ce0bc32bc e3604e771bfd496b946690bba0474b1b d232f2e610e34d14be8031a0bb4d8b15 - - -] Unexpected exception in API method
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 294, in detail
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     servers = self._get_servers(req, is_detail=True)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 409, in _get_servers
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     sort_keys=sort_keys, sort_dirs=sort_dirs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 2129, in get_all
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     sort_keys=sort_keys, sort_dirs=sort_dirs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 2179, in _get_instances_by_filters
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     expected_attrs=fields, sort_keys=sort_keys, sort_dirs=sort_dirs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 181, in wrapper
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     result = fn(cls, context, *args, **kwargs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/objects/instance.py", line 1065, in get_by_filters
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     use_slave=use_slave, sort_keys=sort_keys, sort_dirs=sort_dirs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 285, in wrapper
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/objects/instance.py", line 1049, in _get_by_filters_impl
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     sort_keys=sort_keys, sort_dirs=sort_dirs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 734, in instance_get_all_by_filters_sort
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     sort_dirs=sort_dirs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 229, in wrapper
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 330, in wrapped
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return f(context, *args, **kwargs)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 2311, in instance_get_all_by_filters_sort
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return _instances_fill_metadata(context, query_prefix.all(), manual_joins)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 2056, in _instances_fill_metadata
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     inst = dict(inst)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 117, in keys
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return [key for key, value in self.iteritems()]
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 109, in iteritems
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return six.iteritems(self._as_dict())
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 101, in _as_dict
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     local = dict((key, value) for key, value in self)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 101, in <genexpr>
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     local = dict((key, value) for key, value in self)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/six.py", line 558, in next
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return type(self).__next__(self)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 132, in __next__
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return n, getattr(self.model, n)
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/models.py", line 240, in name
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     base_name = CONF.instance_name_template %% info
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions TypeError: %x format: a number is required, not dict
2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions 
2017-01-18 06:17:58.691 1248 INFO nova.api.openstack.wsgi [req-e4be7ec8-1e0f-43ed-a576-099ce0bc32bc e3604e771bfd496b946690bba0474b1b d232f2e610e34d14be8031a0bb4d8b15 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<type 'exceptions.TypeError'>

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1657423

Title:
  Instances view in Dashboard spawns "Error: Unable to retrieve instance
  list."

Status in OpenStack Compute (nova):
  New

Bug description:
  I'm running Mitaka on Ubuntu 16.04 and when I try to access Instances
  list in Dashboard, the following is error is spawned: Error: Unable to
  retrieve instance list. Same error is spawned for all users.

  Same thing happens in CLI:
  nova list --all-tenants
  ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-30134c69-6c89-4437-9fd7-a2ca7b169ed7)

  Debug output of the same command from above:
  nova --debug list --all-tenants
  DEBUG (extension:157) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
  DEBUG (extension:157) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
  DEBUG (extension:157) found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode')
  DEBUG (extension:157) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
  DEBUG (extension:157) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
  DEBUG (extension:157) found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword')
  DEBUG (extension:157) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
  DEBUG (extension:157) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
  DEBUG (extension:157) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
  DEBUG (session:248) REQ: curl -g -i -X GET http://10.0.0.1:35357/v3 -H "Accept: application/json" -H "User-Agent: keystoneauth1/2.4.1 python-requests/2.9.1 CPython/2.7.12"
  INFO (connectionpool:208) Starting new HTTP connection (1): 10.0.0.1
  DEBUG (connectionpool:388) "GET /v3 HTTP/1.1" 200 248
  DEBUG (session:277) RESP: [200] Content-Length: 248 Vary: X-Auth-Token Server: Apache/2.4.18 (Ubuntu) Date: Wed, 18 Jan 2017 11:25:28 GMT x-openstack-request-id: req-43f828d7-4919-4d24-acbf-513c1b7fa496 Content-Type: application/json X-Distribution: Ubuntu 
  RESP BODY: {"version": {"status": "stable", "updated": "2016-04-04T00:00:00Z", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.identity-v3+json"}], "id": "v3.6", "links": [{"href": "http://10.0.0.1:35357/v3/";, "rel": "self"}]}}

  DEBUG (base:165) Making authentication request to http://10.0.0.1:35357/v3/auth/tokens
  DEBUG (connectionpool:388) "POST /v3/auth/tokens HTTP/1.1" 201 7476
  DEBUG (session:248) REQ: curl -g -i -X GET http://10.0.0.1:8774/v2.1/b77576d7ea0c45a3a24a8da20dbe983e -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}c3bd40d9088aa0e9755d065fa91cea9d5736b361"
  INFO (connectionpool:208) Starting new HTTP connection (1): 10.0.0.1
  DEBUG (connectionpool:388) "GET /v2.1/b77576d7ea0c45a3a24a8da20dbe983e HTTP/1.1" 404 52
  DEBUG (session:277) RESP: [404] Date: Wed, 18 Jan 2017 11:25:33 GMT Content-Length: 52 Content-Type: text/plain; charset=UTF-8 X-Compute-Request-Id: req-06891843-9fe6-432f-b038-2191efd401b0 
  RESP BODY: 404 Not Found

  The resource could not be found.


  DEBUG (session:248) REQ: curl -g -i -X GET http://10.0.0.1:8774/v2.1/ -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-Auth-Token: {SHA1}c3bd40d9088aa0e9755d065fa91cea9d5736b361"
  DEBUG (connectionpool:388) "GET /v2.1/ HTTP/1.1" 200 382
  DEBUG (session:277) RESP: [200] Content-Length: 382 X-Compute-Request-Id: req-732fd6ce-57b0-4858-9740-4bbd9899de6a Vary: X-OpenStack-Nova-API-Version X-Openstack-Nova-Api-Version: 2.1 Date: Wed, 18 Jan 2017 11:25:33 GMT Content-Type: application/json 
  RESP BODY: {"version": {"status": "CURRENT", "updated": "2013-07-23T11:33:21Z", "links": [{"href": "http://10.0.0.1:8774/v2.1/";, "rel": "self"}, {"href": "http://docs.openstack.org/";, "type": "text/html", "rel": "describedby"}], "min_version": "2.1", "version": "2.25", "media-types": [{"base": "application/json", "type": "application/vnd.openstack.compute+json;version=2.1"}], "id": "v2.1"}}

  DEBUG (extension:157) found extension EntryPoint.parse('v2token = keystoneauth1.loading._plugins.identity.v2:Token')
  DEBUG (extension:157) found extension EntryPoint.parse('admin_token = keystoneauth1.loading._plugins.admin_token:AdminToken')
  DEBUG (extension:157) found extension EntryPoint.parse('v3oidcauthcode = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectAuthorizationCode')
  DEBUG (extension:157) found extension EntryPoint.parse('v2password = keystoneauth1.loading._plugins.identity.v2:Password')
  DEBUG (extension:157) found extension EntryPoint.parse('v3password = keystoneauth1.loading._plugins.identity.v3:Password')
  DEBUG (extension:157) found extension EntryPoint.parse('v3oidcpassword = keystoneauth1.loading._plugins.identity.v3:OpenIDConnectPassword')
  DEBUG (extension:157) found extension EntryPoint.parse('token = keystoneauth1.loading._plugins.identity.generic:Token')
  DEBUG (extension:157) found extension EntryPoint.parse('v3token = keystoneauth1.loading._plugins.identity.v3:Token')
  DEBUG (extension:157) found extension EntryPoint.parse('password = keystoneauth1.loading._plugins.identity.generic:Password')
  DEBUG (session:248) REQ: curl -g -i -X GET http://10.0.0.1:8774/v2.1/b77576d7ea0c45a3a24a8da20dbe983e/servers/detail?all_tenants=1 -H "User-Agent: python-novaclient" -H "Accept: application/json" -H "X-OpenStack-Nova-API-Version: 2.25" -H "X-Auth-Token: {SHA1}c3bd40d9088aa0e9755d065fa91cea9d5736b361"
  DEBUG (connectionpool:388) "GET /v2.1/b77576d7ea0c45a3a24a8da20dbe983e/servers/detail?all_tenants=1 HTTP/1.1" 500 193
  DEBUG (session:277) RESP: [500] Content-Length: 193 X-Compute-Request-Id: req-071a25d2-3d7d-4d53-b2a5-d33643a39570 Vary: X-OpenStack-Nova-API-Version X-Openstack-Nova-Api-Version: 2.25 Date: Wed, 18 Jan 2017 11:25:33 GMT Content-Type: application/json; charset=UTF-8 
  RESP BODY: {"computeFault": {"message": "Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.\n<type 'exceptions.TypeError'>", "code": 500}}

  DEBUG (shell:1082) Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-071a25d2-3d7d-4d53-b2a5-d33643a39570)
  Traceback (most recent call last):
    File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 1080, in main
      OpenStackComputeShell().main(argv)
    File "/usr/lib/python2.7/dist-packages/novaclient/shell.py", line 1007, in main
      args.func(self.cs, args)
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/shell.py", line 1513, in do_list
      limit=args.limit)
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 749, in list
      "servers")
    File "/usr/lib/python2.7/dist-packages/novaclient/base.py", line 242, in _list
      resp, body = self.api.client.get(url)
    File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 173, in get
      return self.request(url, 'GET', **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 94, in request
      raise exceptions.from_response(resp, body, url, method)
  ClientException: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-071a25d2-3d7d-4d53-b2a5-d33643a39570)
  ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <type 'exceptions.TypeError'> (HTTP 500) (Request-ID: req-071a25d2-3d7d-4d53-b2a5-d33643a39570)

  Following is the nova-api log with relevant info:

  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions [req-e4be7ec8-1e0f-43ed-a576-099ce0bc32bc e3604e771bfd496b946690bba0474b1b d232f2e610e34d14be8031a0bb4d8b15 - - -] Unexpected exception in API method
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 478, in wrapped
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 294, in detail
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     servers = self._get_servers(req, is_detail=True)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 409, in _get_servers
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     sort_keys=sort_keys, sort_dirs=sort_dirs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 2129, in get_all
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     sort_keys=sort_keys, sort_dirs=sort_dirs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 2179, in _get_instances_by_filters
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     expected_attrs=fields, sort_keys=sort_keys, sort_dirs=sort_dirs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 181, in wrapper
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     result = fn(cls, context, *args, **kwargs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/objects/instance.py", line 1065, in get_by_filters
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     use_slave=use_slave, sort_keys=sort_keys, sort_dirs=sort_dirs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 285, in wrapper
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/objects/instance.py", line 1049, in _get_by_filters_impl
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     sort_keys=sort_keys, sort_dirs=sort_dirs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 734, in instance_get_all_by_filters_sort
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     sort_dirs=sort_dirs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 229, in wrapper
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 330, in wrapped
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return f(context, *args, **kwargs)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 2311, in instance_get_all_by_filters_sort
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return _instances_fill_metadata(context, query_prefix.all(), manual_joins)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 2056, in _instances_fill_metadata
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     inst = dict(inst)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 117, in keys
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return [key for key, value in self.iteritems()]
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 109, in iteritems
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return six.iteritems(self._as_dict())
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 101, in _as_dict
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     local = dict((key, value) for key, value in self)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 101, in <genexpr>
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     local = dict((key, value) for key, value in self)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/six.py", line 558, in next
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return type(self).__next__(self)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 132, in __next__
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     return n, getattr(self.model, n)
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/models.py", line 240, in name
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions     base_name = CONF.instance_name_template %% info
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions TypeError: %x format: a number is required, not dict
  2017-01-18 06:17:58.686 1248 ERROR nova.api.openstack.extensions 
  2017-01-18 06:17:58.691 1248 INFO nova.api.openstack.wsgi [req-e4be7ec8-1e0f-43ed-a576-099ce0bc32bc e3604e771bfd496b946690bba0474b1b d232f2e610e34d14be8031a0bb4d8b15 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <type 'exceptions.TypeError'>

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1657423/+subscriptions


Follow ups