yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1715770] [NEW] openstack image list throwing 500 error

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Madhu <1715770@xxxxxxxxxxxxxxxxxx>
Date: Fri, 08 Sep 2017 00:20:48 -0000
Reply-to: Bug 1715770 <1715770@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

I can list service catalog without issues 
openstack catalog list
+----------+----------+-----------------------------------------+
| Name     | Type     | Endpoints                               |
+----------+----------+-----------------------------------------+
| keystone | identity | RegionOne                               |
|          |          |   public: http://controller1:5000/v3/   |
|          |          | RegionOne                               |
|          |          |   admin: http://controller1:35357/v3/   |
|          |          | RegionOne                               |
|          |          |   internal: http://controller1:5000/v3/ |
|          |          |                                         |
| glance   | image    | RegionOne                               |
|          |          |   admin: http://controller1:9292        |
|          |          | RegionOne                               |
|          |          |   public: http://controller1:9292       |
|          |          | RegionOne                               |
|          |          |   internal: http://controller1:9292     |
|          |          |                                         |
+----------+----------+-----------------------------------------+

but when I use openstack image list it is throwing 500 error, following
is from glance-api log.

Installation is on Ubuntu17.04 + octa release

2017-09-07 17:17:41.096 19450 DEBUG eventlet.wsgi.server [-] (19450) accepted ('192.168.1.45', 43908) server /usr/lib/python2.7/dist-packages/eventlet/wsgi.py:868
2017-09-07 17:17:41.099 19450 DEBUG glance.api.middleware.version_negotiation [-] Determining version of request: GET /v2/images Accept: */* process_request /usr/local/lib/python2.7/dist-packages/glance/api/middleware/version_negotiation.py:46
2017-09-07 17:17:41.099 19450 DEBUG glance.api.middleware.version_negotiation [-] Using url versioning process_request /usr/local/lib/python2.7/dist-packages/glance/api/middleware/version_negotiation.py:58
2017-09-07 17:17:41.100 19450 DEBUG glance.api.middleware.version_negotiation [-] Matched version: v2 process_request /usr/local/lib/python2.7/dist-packages/glance/api/middleware/version_negotiation.py:70
2017-09-07 17:17:41.100 19450 DEBUG glance.api.middleware.version_negotiation [-] new path /v2/images process_request /usr/local/lib/python2.7/dist-packages/glance/api/middleware/version_negotiation.py:71
2017-09-07 17:17:41.244 19450 INFO eventlet.wsgi.server [-] Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 481, in handle_one_response
    result = self.application(self.environ, start_response)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
    resp = self.call_func(req, *args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
    return self.func(req, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/oslo_middleware/base.py", line 126, in __call__
    response = req.get_response(self.application)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
    application, catch_exc_info=False)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
    app_iter = application(self.environ, start_response)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
    resp = self.call_func(req, *args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
    return self.func(req, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/oslo_middleware/base.py", line 126, in __call__
    response = req.get_response(self.application)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
    application, catch_exc_info=False)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
    app_iter = application(self.environ, start_response)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
    resp = self.call_func(req, *args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
    return self.func(req, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/oslo_middleware/base.py", line 126, in __call__
    response = req.get_response(self.application)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
    application, catch_exc_info=False)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
    app_iter = application(self.environ, start_response)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
    resp = self.call_func(req, *args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
    return self.func(req, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/glance/common/wsgi.py", line 804, in __call__
    response = req.get_response(self.application)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
    application, catch_exc_info=False)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
    app_iter = application(self.environ, start_response)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
    resp = self.call_func(req, *args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
    return self.func(req, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/osprofiler/web.py", line 108, in __call__
    return request.get_response(self.application)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
    application, catch_exc_info=False)
  File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
    app_iter = application(self.environ, start_response)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
    resp = self.call_func(req, *args, **self.kwargs)
  File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
    return self.func(req, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 332, in __call__
    response = self.process_request(req)
  File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 623, in process_request
    resp = super(AuthProtocol, self).process_request(request)
  File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 405, in process_request
    allow_expired=allow_expired)
  File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 435, in _do_fetch_token
    data = self.fetch_token(token, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 762, in fetch_token
    allow_expired=allow_expired)
  File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_identity.py", line 217, in verify_token
    auth_ref = self._request_strategy.verify_token(
  File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_identity.py", line 168, in _request_strategy
    strategy_class = self._get_strategy_class()
  File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_identity.py", line 190, in _get_strategy_class
    if self._adapter.get_endpoint(version=klass.AUTH_VERSION):
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 176, in get_endpoint
    return self.session.get_endpoint(auth or self.auth, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 856, in get_endpoint
    return auth.get_endpoint(self, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 216, in get_endpoint
    service_name=service_name)
  File "/usr/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
    return wrapped(*args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/access/service_catalog.py", line 190, in url_for
    raise exceptions.EmptyCatalog('The service catalog is empty.')
EmptyCatalog: The service catalog is empty.

2017-09-07 17:17:41.245 19450 INFO eventlet.wsgi.server [-] 192.168.1.45
- - [07/Sep/2017 17:17:41] "GET /v2/images HTTP/1.1" 500 139 0.146946

** Affects: keystone
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Identity (keystone).
https://bugs.launchpad.net/bugs/1715770

Title:
  openstack image list throwing 500 error

Status in OpenStack Identity (keystone):
  New

Bug description:
  I can list service catalog without issues 
  openstack catalog list
  +----------+----------+-----------------------------------------+
  | Name     | Type     | Endpoints                               |
  +----------+----------+-----------------------------------------+
  | keystone | identity | RegionOne                               |
  |          |          |   public: http://controller1:5000/v3/   |
  |          |          | RegionOne                               |
  |          |          |   admin: http://controller1:35357/v3/   |
  |          |          | RegionOne                               |
  |          |          |   internal: http://controller1:5000/v3/ |
  |          |          |                                         |
  | glance   | image    | RegionOne                               |
  |          |          |   admin: http://controller1:9292        |
  |          |          | RegionOne                               |
  |          |          |   public: http://controller1:9292       |
  |          |          | RegionOne                               |
  |          |          |   internal: http://controller1:9292     |
  |          |          |                                         |
  +----------+----------+-----------------------------------------+

  but when I use openstack image list it is throwing 500 error,
  following is from glance-api log.

  Installation is on Ubuntu17.04 + octa release

  2017-09-07 17:17:41.096 19450 DEBUG eventlet.wsgi.server [-] (19450) accepted ('192.168.1.45', 43908) server /usr/lib/python2.7/dist-packages/eventlet/wsgi.py:868
  2017-09-07 17:17:41.099 19450 DEBUG glance.api.middleware.version_negotiation [-] Determining version of request: GET /v2/images Accept: */* process_request /usr/local/lib/python2.7/dist-packages/glance/api/middleware/version_negotiation.py:46
  2017-09-07 17:17:41.099 19450 DEBUG glance.api.middleware.version_negotiation [-] Using url versioning process_request /usr/local/lib/python2.7/dist-packages/glance/api/middleware/version_negotiation.py:58
  2017-09-07 17:17:41.100 19450 DEBUG glance.api.middleware.version_negotiation [-] Matched version: v2 process_request /usr/local/lib/python2.7/dist-packages/glance/api/middleware/version_negotiation.py:70
  2017-09-07 17:17:41.100 19450 DEBUG glance.api.middleware.version_negotiation [-] new path /v2/images process_request /usr/local/lib/python2.7/dist-packages/glance/api/middleware/version_negotiation.py:71
  2017-09-07 17:17:41.244 19450 INFO eventlet.wsgi.server [-] Traceback (most recent call last):
    File "/usr/lib/python2.7/dist-packages/eventlet/wsgi.py", line 481, in handle_one_response
      result = self.application(self.environ, start_response)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
      resp = self.call_func(req, *args, **self.kwargs)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
      return self.func(req, *args, **kwargs)
    File "/usr/lib/python2.7/dist-packages/oslo_middleware/base.py", line 126, in __call__
      response = req.get_response(self.application)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
      application, catch_exc_info=False)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
      app_iter = application(self.environ, start_response)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
      resp = self.call_func(req, *args, **self.kwargs)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
      return self.func(req, *args, **kwargs)
    File "/usr/lib/python2.7/dist-packages/oslo_middleware/base.py", line 126, in __call__
      response = req.get_response(self.application)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
      application, catch_exc_info=False)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
      app_iter = application(self.environ, start_response)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
      resp = self.call_func(req, *args, **self.kwargs)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
      return self.func(req, *args, **kwargs)
    File "/usr/lib/python2.7/dist-packages/oslo_middleware/base.py", line 126, in __call__
      response = req.get_response(self.application)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
      application, catch_exc_info=False)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
      app_iter = application(self.environ, start_response)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
      resp = self.call_func(req, *args, **self.kwargs)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
      return self.func(req, *args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/glance/common/wsgi.py", line 804, in __call__
      response = req.get_response(self.application)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
      application, catch_exc_info=False)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
      app_iter = application(self.environ, start_response)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
      resp = self.call_func(req, *args, **self.kwargs)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
      return self.func(req, *args, **kwargs)
    File "/usr/lib/python2.7/dist-packages/osprofiler/web.py", line 108, in __call__
      return request.get_response(self.application)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1299, in send
      application, catch_exc_info=False)
    File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1263, in call_application
      app_iter = application(self.environ, start_response)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
      resp = self.call_func(req, *args, **self.kwargs)
    File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
      return self.func(req, *args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 332, in __call__
      response = self.process_request(req)
    File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 623, in process_request
      resp = super(AuthProtocol, self).process_request(request)
    File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 405, in process_request
      allow_expired=allow_expired)
    File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 435, in _do_fetch_token
      data = self.fetch_token(token, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/__init__.py", line 762, in fetch_token
      allow_expired=allow_expired)
    File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_identity.py", line 217, in verify_token
      auth_ref = self._request_strategy.verify_token(
    File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_identity.py", line 168, in _request_strategy
      strategy_class = self._get_strategy_class()
    File "/usr/local/lib/python2.7/dist-packages/keystonemiddleware/auth_token/_identity.py", line 190, in _get_strategy_class
      if self._adapter.get_endpoint(version=klass.AUTH_VERSION):
    File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 176, in get_endpoint
      return self.session.get_endpoint(auth or self.auth, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/session.py", line 856, in get_endpoint
      return auth.get_endpoint(self, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/identity/base.py", line 216, in get_endpoint
      service_name=service_name)
    File "/usr/lib/python2.7/dist-packages/positional/__init__.py", line 101, in inner
      return wrapped(*args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/keystoneauth1/access/service_catalog.py", line 190, in url_for
      raise exceptions.EmptyCatalog('The service catalog is empty.')
  EmptyCatalog: The service catalog is empty.

  2017-09-07 17:17:41.245 19450 INFO eventlet.wsgi.server [-]
  192.168.1.45 - - [07/Sep/2017 17:17:41] "GET /v2/images HTTP/1.1" 500
  139 0.146946

To manage notifications about this bug go to:
https://bugs.launchpad.net/keystone/+bug/1715770/+subscriptions
Follow ups

[Bug 1715770] Re: openstack image list throwing 500 error
From: Madhu, 2017-09-08