← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1557079] [NEW] 'glanceclient.exc.HTTPUnauthorized' even though password is correct

 

Public bug reported:

I am installing OpenStack using Nova and have configured everything according to the OpenStack Liberty installation guide:
http://docs.openstack.org/liberty/install-guide-ubuntu/nova-verify.html

Everything has worked fine up to the "Add the Compute Service | Verify operation" section where it tells you to run the 'nova image-list' command on the controller node. When I run that it fails with:
----
ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'glanceclient.exc.HTTPUnauthorized'> (HTTP 500) (Request-ID: req-d22e03ec-3ad5-4cf6-979b-f22815a511ec)
----
An internet search brings up recommendations to check to check the Nova and Glance configs since the error in the nova-api.log file indicates that the password is wrong:
----
2016-03-14 17:04:54.612 4991 INFO nova.api.openstack.wsgi [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'glanceclient.exc.HTTPUnauthorized'>
2016-03-14 17:04:54.613 4991 INFO nova.osapi_compute.wsgi.server [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] 192.168.0.129 "GET /v2/a0049134d7444d55a8714a2d0d94f2c1/images/detail HTTP/1.1" status: 500 len: 438 time: 0.1273541
----

However I have rechecked both configs and everything is, or seems to be,
correct. If I run 'glance image-list' it works fine, it is 'nova image-
list' that fails.

My nova.conf file:
----
[DEFAULT]
my_ip = 192.168.0.129
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
libvirt_use_virtio_for_bridges=True
verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
#enabled_apis=ec2,osapi_compute,metadata
enabled_apis=osapi_compute,metadata
auth_strategy = keystone
network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
linuxnet_interface_driver = nova.network.linux_net.NeutronLinuxBridgeInterfaceDriver
firewall_driver = nova.virt.firewall.NoopFirewallDriver

[keystone_authtoken]
auth_uri = http://controller:5000
auth_url = http://controller:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = nova
password = password

rpc_backend = rabbit

[oslo_messaging_rabbit]
rabbit_host = controller
rabbit_userid = openstack
rabbit_password = password

[oslo_concurrency]
lock_path = /var/lib/nova/tmp

[database]
connection = mysql+pymysql://nova:password@controller/nova

[vnc]
vncserver_listen = $my_ip
vncserver_proxyclient_address = $my_ip

[glance]
host = 192.168.0.129
----

The errors from my glance-api.log file:
----
2016-03-14 17:03:42.357 5006 INFO nova.metadata.wsgi.server [-] (5006) wsgi starting up on http://0.0.0.0:8775/
2016-03-14 17:04:54.345 4991 INFO nova.osapi_compute.wsgi.server [req-86f098d0-434c-4b93-b8d1-b1a80168bed8 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] 192.168.0.129 "GET /v2/ HTTP/1.1" status: 200 len: 572 time: 0.4849169
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] Unexpected exception in API method
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/images.py", line 145, in detail
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     **page_params)
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/image/api.py", line 68, in get_all
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     return session.detail(context, **kwargs)
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 284, in detail
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     for image in images:
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 254, in list
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     for image in paginate(params, return_request_id):
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 238, in paginate
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     images, resp = self._list(url, "images")
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 63, in _list
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     resp, body = self.client.get(url)
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 280, in get
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     return self._request('GET', url, **kwargs)
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 272, in _request
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     resp, body_iter = self._handle_response(resp)
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 93, in _handle_response
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     raise exc.from_response(resp, resp.content)
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions HTTPUnauthorized: 401 Unauthorized: Authentication required (HTTP 401)
2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions 
2016-03-14 17:04:54.612 4991 INFO nova.api.openstack.wsgi [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'glanceclient.exc.HTTPUnauthorized'>
2016-03-14 17:04:54.613 4991 INFO nova.osapi_compute.wsgi.server [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] 192.168.0.129 "GET /v2/a0049134d7444d55a8714a2d0d94f2c1/images/detail HTTP/1.1" status: 500 len: 438 time: 0.1273541
----

The 401 error suggests that there is a login ID/password that is
incorrect yet the credentials in the keystone_authtoken section are
correct. I am wondering if there is a section of config missing from the
nova.cfg file though I fear I cannot work out what it might be.

Your suggestions would be appreciated.

Nova version:
----
# dpkg -l |grep nova
ii  nova-api                                              2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - API frontend
ii  nova-cert                                             2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - certificate management
ii  nova-common                                           2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - common files
ii  nova-conductor                                        2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - conductor service
ii  nova-consoleauth                                      2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - Console Authenticator
ii  nova-novncproxy                                       2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - NoVNC proxy
ii  nova-scheduler                                        2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - virtual machine scheduler
ii  python-nova                                           2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute Python libraries
ii  python-novaclient                                     2:2.30.1-1~cloud0                                   all          client library for OpenStack Compute API
----


|\/|artin

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1557079

Title:
  'glanceclient.exc.HTTPUnauthorized' even though password is correct

Status in OpenStack Compute (nova):
  New

Bug description:
  I am installing OpenStack using Nova and have configured everything according to the OpenStack Liberty installation guide:
  http://docs.openstack.org/liberty/install-guide-ubuntu/nova-verify.html

  Everything has worked fine up to the "Add the Compute Service | Verify operation" section where it tells you to run the 'nova image-list' command on the controller node. When I run that it fails with:
  ----
  ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'glanceclient.exc.HTTPUnauthorized'> (HTTP 500) (Request-ID: req-d22e03ec-3ad5-4cf6-979b-f22815a511ec)
  ----
  An internet search brings up recommendations to check to check the Nova and Glance configs since the error in the nova-api.log file indicates that the password is wrong:
  ----
  2016-03-14 17:04:54.612 4991 INFO nova.api.openstack.wsgi [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'glanceclient.exc.HTTPUnauthorized'>
  2016-03-14 17:04:54.613 4991 INFO nova.osapi_compute.wsgi.server [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] 192.168.0.129 "GET /v2/a0049134d7444d55a8714a2d0d94f2c1/images/detail HTTP/1.1" status: 500 len: 438 time: 0.1273541
  ----

  However I have rechecked both configs and everything is, or seems to
  be, correct. If I run 'glance image-list' it works fine, it is 'nova
  image-list' that fails.

  My nova.conf file:
  ----
  [DEFAULT]
  my_ip = 192.168.0.129
  dhcpbridge_flagfile=/etc/nova/nova.conf
  dhcpbridge=/usr/bin/nova-dhcpbridge
  logdir=/var/log/nova
  state_path=/var/lib/nova
  lock_path=/var/lock/nova
  force_dhcp_release=True
  libvirt_use_virtio_for_bridges=True
  verbose=True
  ec2_private_dns_show_ip=True
  api_paste_config=/etc/nova/api-paste.ini
  #enabled_apis=ec2,osapi_compute,metadata
  enabled_apis=osapi_compute,metadata
  auth_strategy = keystone
  network_api_class = nova.network.neutronv2.api.API
  security_group_api = neutron
  linuxnet_interface_driver = nova.network.linux_net.NeutronLinuxBridgeInterfaceDriver
  firewall_driver = nova.virt.firewall.NoopFirewallDriver

  [keystone_authtoken]
  auth_uri = http://controller:5000
  auth_url = http://controller:35357
  auth_plugin = password
  project_domain_id = default
  user_domain_id = default
  project_name = service
  username = nova
  password = password

  rpc_backend = rabbit

  [oslo_messaging_rabbit]
  rabbit_host = controller
  rabbit_userid = openstack
  rabbit_password = password

  [oslo_concurrency]
  lock_path = /var/lib/nova/tmp

  [database]
  connection = mysql+pymysql://nova:password@controller/nova

  [vnc]
  vncserver_listen = $my_ip
  vncserver_proxyclient_address = $my_ip

  [glance]
  host = 192.168.0.129
  ----

  The errors from my glance-api.log file:
  ----
  2016-03-14 17:03:42.357 5006 INFO nova.metadata.wsgi.server [-] (5006) wsgi starting up on http://0.0.0.0:8775/
  2016-03-14 17:04:54.345 4991 INFO nova.osapi_compute.wsgi.server [req-86f098d0-434c-4b93-b8d1-b1a80168bed8 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] 192.168.0.129 "GET /v2/ HTTP/1.1" status: 200 len: 572 time: 0.4849169
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] Unexpected exception in API method
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/extensions.py", line 478, in wrapped
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/images.py", line 145, in detail
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     **page_params)
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/image/api.py", line 68, in get_all
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     return session.detail(context, **kwargs)
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 284, in detail
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     for image in images:
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 254, in list
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     for image in paginate(params, return_request_id):
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 238, in paginate
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     images, resp = self._list(url, "images")
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/v1/images.py", line 63, in _list
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     resp, body = self.client.get(url)
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 280, in get
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     return self._request('GET', url, **kwargs)
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 272, in _request
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     resp, body_iter = self._handle_response(resp)
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/glanceclient/common/http.py", line 93, in _handle_response
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions     raise exc.from_response(resp, resp.content)
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions HTTPUnauthorized: 401 Unauthorized: Authentication required (HTTP 401)
  2016-03-14 17:04:54.610 4991 ERROR nova.api.openstack.extensions 
  2016-03-14 17:04:54.612 4991 INFO nova.api.openstack.wsgi [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'glanceclient.exc.HTTPUnauthorized'>
  2016-03-14 17:04:54.613 4991 INFO nova.osapi_compute.wsgi.server [req-d22e03ec-3ad5-4cf6-979b-f22815a511ec 80ce7bd86a444065bd9ceace0bf1f87d a0049134d7444d55a8714a2d0d94f2c1 - - -] 192.168.0.129 "GET /v2/a0049134d7444d55a8714a2d0d94f2c1/images/detail HTTP/1.1" status: 500 len: 438 time: 0.1273541
  ----

  The 401 error suggests that there is a login ID/password that is
  incorrect yet the credentials in the keystone_authtoken section are
  correct. I am wondering if there is a section of config missing from
  the nova.cfg file though I fear I cannot work out what it might be.

  Your suggestions would be appreciated.

  Nova version:
  ----
  # dpkg -l |grep nova
  ii  nova-api                                              2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - API frontend
  ii  nova-cert                                             2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - certificate management
  ii  nova-common                                           2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - common files
  ii  nova-conductor                                        2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - conductor service
  ii  nova-consoleauth                                      2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - Console Authenticator
  ii  nova-novncproxy                                       2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - NoVNC proxy
  ii  nova-scheduler                                        2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute - virtual machine scheduler
  ii  python-nova                                           2:12.0.1-0ubuntu1~cloud0                            all          OpenStack Compute Python libraries
  ii  python-novaclient                                     2:2.30.1-1~cloud0                                   all          client library for OpenStack Compute API
  ----

  
  |\/|artin

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1557079/+subscriptions


Follow ups