yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1597237] [NEW] nova service-list error 500

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: fuegoel <1597237@xxxxxxxxxxxxxxxxxx>
Date: Wed, 29 Jun 2016 09:10:06 -0000
Reply-to: Bug 1597237 <1597237@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

I'm installing OpenStack Liberty on Ubuntu 14.04 to get OpenStack and
MidoNet up and running, nova image-list and nova endpoints work fine,
but nova service-list returns the following error:

ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'sqlalchemy.exc.OperationalError'> (HTTP 500) (Request-ID: req-...)

This is the nova-api.log file:
2016-06-29 11:44:37.331 2070 INFO nova.osapi_compute.wsgi.server [req-5f633b2e-0251-4274-8233-efd74f39e26f 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/c3f3f423740546a7b0095e15f34db99c/os$
2016-06-29 11:44:44.606 2069 INFO nova.osapi_compute.wsgi.server [req-5aa1e4c3-aa60-4fb4-aecf-38e26430f25d 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/ HTTP/1.1" status: 200 len: 572 tim$
2016-06-29 11:44:49.404 2065 INFO nova.osapi_compute.wsgi.server [req-31cd18c4-2471-4adf-92d3-e44b7b238376 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/ HTTP/1.1" status: 200 len: 572 tim$
2016-06-29 11:44:49.723 2065 INFO nova.osapi_compute.wsgi.server [req-89c7dffd-5d7f-41ef-8188-27013a7cf059 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/c3f3f423740546a7b0095e15f34db99c/im$
2016-06-29 11:49:53.786 2069 INFO nova.osapi_compute.wsgi.server [req-4dadce44-e6f4-4420-9ed6-a75563d6ac03 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/ HTTP/1.1" status: 200 len: 572 tim$
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions [req-0977797e-613e-44e3-bdf7-f210a99c4de1 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] Unexpected exception in API method
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/services.py", line 188, in index
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     _services = self._get_services_list(req)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/services.py", line 80, in _get_services_list
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     _services = self._get_services(req)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/services.py", line 44, in _get_services
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     _services = self.host_api.service_get_all(context, set_zones=True)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 3497, in service_get_all
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     set_zones=set_zones)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 171, in wrapper
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     result = fn(cls, context, *args, **kwargs)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/objects/service.py", line 313, in get_all
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     db_services = db.service_get_all(context, disabled=disabled)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 115, in service_get_all
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return IMPL.service_get_all(context, disabled)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 449, in service_get_all
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return query.all()
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2399, in all
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return list(self)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2516, in __iter__
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return self._execute_and_instances(context)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2531, in _execute_and_instances
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     result = conn.execute(querycontext.statement, self._params)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return meth(self, multiparams, params)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return connection._execute_clauseelement(self, multiparams, params)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     compiled_sql, distilled_params
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     context)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     util.raise_from_cause(newraise, exc_info)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     reraise(type(exception), exception, tb=exc_tb)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     context)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     cursor.execute(statement, parameters)
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions OperationalError: (sqlite3.OperationalError) no such table: services [SQL: u'SELECT services.created_at AS services_created_at, services.updated_at AS services_updated_at,$
2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions
2016-06-29 11:49:53.960 2069 INFO nova.api.openstack.wsgi [req-0977797e-613e-44e3-bdf7-f210a99c4de1 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] HTTP exception thrown: Unexpected API Error. Please report this$
<class 'sqlalchemy.exc.OperationalError'>
2016-06-29 11:49:53.961 2069 INFO nova.osapi_compute.wsgi.server [req-0977797e-613e-44e3-bdf7-f210a99c4de1 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/c3f3f423740546a7b0095e15f34db99c/os$

Please help me.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1597237

Title:
  nova service-list error 500

Status in OpenStack Compute (nova):
  New

Bug description:
  I'm installing OpenStack Liberty on Ubuntu 14.04 to get OpenStack and
  MidoNet up and running, nova image-list and nova endpoints work fine,
  but nova service-list returns the following error:

  ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'sqlalchemy.exc.OperationalError'> (HTTP 500) (Request-ID: req-...)

  This is the nova-api.log file:
  2016-06-29 11:44:37.331 2070 INFO nova.osapi_compute.wsgi.server [req-5f633b2e-0251-4274-8233-efd74f39e26f 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/c3f3f423740546a7b0095e15f34db99c/os$
  2016-06-29 11:44:44.606 2069 INFO nova.osapi_compute.wsgi.server [req-5aa1e4c3-aa60-4fb4-aecf-38e26430f25d 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/ HTTP/1.1" status: 200 len: 572 tim$
  2016-06-29 11:44:49.404 2065 INFO nova.osapi_compute.wsgi.server [req-31cd18c4-2471-4adf-92d3-e44b7b238376 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/ HTTP/1.1" status: 200 len: 572 tim$
  2016-06-29 11:44:49.723 2065 INFO nova.osapi_compute.wsgi.server [req-89c7dffd-5d7f-41ef-8188-27013a7cf059 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/c3f3f423740546a7b0095e15f34db99c/im$
  2016-06-29 11:49:53.786 2069 INFO nova.osapi_compute.wsgi.server [req-4dadce44-e6f4-4420-9ed6-a75563d6ac03 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/ HTTP/1.1" status: 200 len: 572 tim$
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions [req-0977797e-613e-44e3-bdf7-f210a99c4de1 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] Unexpected exception in API method
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 478, in wrapped
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/services.py", line 188, in index
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     _services = self._get_services_list(req)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/services.py", line 80, in _get_services_list
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     _services = self._get_services(req)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/services.py", line 44, in _get_services
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     _services = self.host_api.service_get_all(context, set_zones=True)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 3497, in service_get_all
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     set_zones=set_zones)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 171, in wrapper
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     result = fn(cls, context, *args, **kwargs)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/objects/service.py", line 313, in get_all
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     db_services = db.service_get_all(context, disabled=disabled)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/api.py", line 115, in service_get_all
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return IMPL.service_get_all(context, disabled)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/db/sqlalchemy/api.py", line 449, in service_get_all
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return query.all()
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2399, in all
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return list(self)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2516, in __iter__
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return self._execute_and_instances(context)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2531, in _execute_and_instances
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     result = conn.execute(querycontext.statement, self._params)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return meth(self, multiparams, params)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     return connection._execute_clauseelement(self, multiparams, params)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     compiled_sql, distilled_params
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     context)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     util.raise_from_cause(newraise, exc_info)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 199, in raise_from_cause
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     reraise(type(exception), exception, tb=exc_tb)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     context)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions     cursor.execute(statement, parameters)
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions OperationalError: (sqlite3.OperationalError) no such table: services [SQL: u'SELECT services.created_at AS services_created_at, services.updated_at AS services_updated_at,$
  2016-06-29 11:49:53.957 2069 ERROR nova.api.openstack.extensions
  2016-06-29 11:49:53.960 2069 INFO nova.api.openstack.wsgi [req-0977797e-613e-44e3-bdf7-f210a99c4de1 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] HTTP exception thrown: Unexpected API Error. Please report this$
  <class 'sqlalchemy.exc.OperationalError'>
  2016-06-29 11:49:53.961 2069 INFO nova.osapi_compute.wsgi.server [req-0977797e-613e-44e3-bdf7-f210a99c4de1 2fef13dec3c84026aff7cd82ba8f25a9 c3f3f423740546a7b0095e15f34db99c - - -] 10.10.10.11 "GET /v2/c3f3f423740546a7b0095e15f34db99c/os$

  Please help me.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1597237/+subscriptions
Follow ups

[Bug 1597237] Re: nova service-list error 500
From: Sean Dague, 2016-07-01