yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #46261
[Bug 1545313] [NEW] Unable to launch an instance
Public bug reported:
# Description of problem:
"Launch an instance" request doesn't go through nova and openstackclient. Same results.
# System information:
Openstack release: Liberty
OS release: CentOS 7
openstack-nova-common-12.0.1-1.el7.noarch
openstack-nova-novncproxy-12.0.1-1.el7.noarch
python-novaclient-2.30.1-1.el7.noarch
openstack-nova-compute-12.0.1-1.el7.noarch
openstack-nova-conductor-12.0.1-1.el7.noarch
openstack-nova-console-12.0.1-1.el7.noarch
openstack-nova-cert-12.0.1-1.el7.noarch
openstack-nova-scheduler-12.0.1-1.el7.noarch
openstack-nova-api-12.0.1-1.el7.noarch
python-nova-12.0.1-1.el7.noarch
# Installation steps:
http://docs.openstack.org/liberty/install-guide-rdo/
# Configuration:
==> nova/nova.conf <==
[keystone_authtoken]
auth_uri = http://controller:5000/
auth_url = http://controller:35357/
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = nova
password = nova
[neutron]
url = http://controller:9696
auth_uri = http://controller:5000
auth_url = http://controller:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
region_name = RegionOne
project_name = service
user = neutron
pass = neutron
service_metadata_proxy=True
metadata_proxy_shared_secret = e86ad70cd8b877e56603
==> neutron/neutron.conf <==
[keystone_authtoken]
auth_uri = http://controller:5000
auth_url = http://controller:35357
identity_uri = http://controller:5000
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = neutron
password = neutron
[nova]
auth_url = http://controller:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
region_name = RegionOne
project_name = service
username = nova
password = nova
# Reproduce steps:
openstack server create --image "cirros" --nic net-id=51af9b85-8974-47dc-879d-27b6ee4f36ca --flavor m1.tiny --security-group default --os-volume-api-version 1 --key-name adminkey test3
nova boot --flavor m1.tiny --image "cirros" --nic net-id=51af9b85-8974
-47dc-879d-27b6ee4f36ca --security-group default --key-name adminkey
admintest
# Error returned to console:
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneclient.exceptions.BadRequest'> (HTTP 500) (Request-ID: req-7ff9a592-53b5-4334-9484-1c7bc22450ea)
==> keystone/keystone.log <==
2016-02-13 14:54:33.318 23688 DEBUG keystone.common.controller [req-27e83fa7-da62-4f2e-96bd-b970cda09e86 - - - - -] RBAC: Authorization gran
ted inner /usr/lib/python2.7/site-packages/keystone/common/controller.py:162
2016-02-13 14:54:33.451 23691 INFO keystone.common.wsgi [req-56068fb8-0e41-4cf8-9bb2-5c57a9707d8d - - - - -] GET http://controller:35357/
2016-02-13 14:54:33.455 23692 DEBUG keystone.middleware.core [req-4f1bae96-73bf-4ccc-8519-174c8848a1c8 - - - - -] There is either no auth to
ken in the request or the certificate issuer is not trusted. No auth context will be set. process_request /usr/lib/python2.7/site-packages/k
eystone/middleware/core.py:310
2016-02-13 14:54:33.458 23692 INFO keystone.common.wsgi [req-4f1bae96-73bf-4ccc-8519-174c8848a1c8 - - - - -] POST http://controller:35357/v3
/auth/tokens
2016-02-13 14:54:33.469 23692 WARNING keystone.common.wsgi [req-4f1bae96-73bf-4ccc-8519-174c8848a1c8 - - - - -] Expecting to find id or name
in user - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in
error.
==> nova/nova-api.log <==
2016-02-13 14:54:31.283 26962 INFO nova.osapi_compute.wsgi.server [req-7f8769ee-2a2b-40be-80b5-d06eb75ba01c 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] 192.168.2.50 "GET /v2/b8f478528a90485c91b363b57505a047/flavors/1 HTTP/1.1" status: 200 len: 615 time: 0.0232971
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions [req-7ff9a592-53b5-4334-9484-1c7bc22450ea 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] Unexpected exception in API method
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return f(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 611, in create
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions **create_kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 149, in inner
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1581, in create
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1181, in _create_instance
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions auto_disk_config, reservation_id, max_count)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 955, in _validate_and_build_base_options
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions pci_request_info, requested_networks)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1059, in create_pci_requests_for_sriov_ports
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions neutron = get_client(context, admin=True)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 237, in get_client
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions auth_token = _ADMIN_AUTH.get_token(_SESSION)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 200, in get_token
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return self.get_access(session).auth_token
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 240, in get_access
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions self.auth_ref = self.get_auth_ref(session)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 186, in get_auth_ref
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return self._plugin.get_auth_ref(session, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/v3/base.py", line 190, in get_auth_ref
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions authenticated=False, log=False, **rkwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 501, in post
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return self.request(url, 'POST', **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 401, in request
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions raise exceptions.from_response(resp, method, url)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions BadRequest: Expecting to find id or name in user - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4f1bae96-73bf-4ccc-8519-174c8848a1c8)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions
2016-02-13 14:54:33.477 26962 INFO nova.api.openstack.wsgi [req-7ff9a592-53b5-4334-9484-1c7bc22450ea 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneclient.exceptions.BadRequest'>
2016-02-13 14:54:33.479 26962 INFO nova.osapi_compute.wsgi.server [req-7ff9a592-53b5-4334-9484-1c7bc22450ea 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] 192.168.2.50 "POST /v2/b8f478528a90485c91b363b57505a047/servers HTTP/1.1" status: 500 len: 441 time: 1.6943171
** Affects: nova
Importance: Undecided
Status: New
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1545313
Title:
Unable to launch an instance
Status in OpenStack Compute (nova):
New
Bug description:
# Description of problem:
"Launch an instance" request doesn't go through nova and openstackclient. Same results.
# System information:
Openstack release: Liberty
OS release: CentOS 7
openstack-nova-common-12.0.1-1.el7.noarch
openstack-nova-novncproxy-12.0.1-1.el7.noarch
python-novaclient-2.30.1-1.el7.noarch
openstack-nova-compute-12.0.1-1.el7.noarch
openstack-nova-conductor-12.0.1-1.el7.noarch
openstack-nova-console-12.0.1-1.el7.noarch
openstack-nova-cert-12.0.1-1.el7.noarch
openstack-nova-scheduler-12.0.1-1.el7.noarch
openstack-nova-api-12.0.1-1.el7.noarch
python-nova-12.0.1-1.el7.noarch
# Installation steps:
http://docs.openstack.org/liberty/install-guide-rdo/
# Configuration:
==> nova/nova.conf <==
[keystone_authtoken]
auth_uri = http://controller:5000/
auth_url = http://controller:35357/
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = nova
password = nova
[neutron]
url = http://controller:9696
auth_uri = http://controller:5000
auth_url = http://controller:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
region_name = RegionOne
project_name = service
user = neutron
pass = neutron
service_metadata_proxy=True
metadata_proxy_shared_secret = e86ad70cd8b877e56603
==> neutron/neutron.conf <==
[keystone_authtoken]
auth_uri = http://controller:5000
auth_url = http://controller:35357
identity_uri = http://controller:5000
auth_plugin = password
project_domain_id = default
user_domain_id = default
project_name = service
username = neutron
password = neutron
[nova]
auth_url = http://controller:35357
auth_plugin = password
project_domain_id = default
user_domain_id = default
region_name = RegionOne
project_name = service
username = nova
password = nova
# Reproduce steps:
openstack server create --image "cirros" --nic net-id=51af9b85-8974-47dc-879d-27b6ee4f36ca --flavor m1.tiny --security-group default --os-volume-api-version 1 --key-name adminkey test3
nova boot --flavor m1.tiny --image "cirros" --nic net-id=51af9b85-8974
-47dc-879d-27b6ee4f36ca --security-group default --key-name adminkey
admintest
# Error returned to console:
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneclient.exceptions.BadRequest'> (HTTP 500) (Request-ID: req-7ff9a592-53b5-4334-9484-1c7bc22450ea)
==> keystone/keystone.log <==
2016-02-13 14:54:33.318 23688 DEBUG keystone.common.controller [req-27e83fa7-da62-4f2e-96bd-b970cda09e86 - - - - -] RBAC: Authorization gran
ted inner /usr/lib/python2.7/site-packages/keystone/common/controller.py:162
2016-02-13 14:54:33.451 23691 INFO keystone.common.wsgi [req-56068fb8-0e41-4cf8-9bb2-5c57a9707d8d - - - - -] GET http://controller:35357/
2016-02-13 14:54:33.455 23692 DEBUG keystone.middleware.core [req-4f1bae96-73bf-4ccc-8519-174c8848a1c8 - - - - -] There is either no auth to
ken in the request or the certificate issuer is not trusted. No auth context will be set. process_request /usr/lib/python2.7/site-packages/k
eystone/middleware/core.py:310
2016-02-13 14:54:33.458 23692 INFO keystone.common.wsgi [req-4f1bae96-73bf-4ccc-8519-174c8848a1c8 - - - - -] POST http://controller:35357/v3
/auth/tokens
2016-02-13 14:54:33.469 23692 WARNING keystone.common.wsgi [req-4f1bae96-73bf-4ccc-8519-174c8848a1c8 - - - - -] Expecting to find id or name
in user - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in
error.
==> nova/nova-api.log <==
2016-02-13 14:54:31.283 26962 INFO nova.osapi_compute.wsgi.server [req-7f8769ee-2a2b-40be-80b5-d06eb75ba01c 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] 192.168.2.50 "GET /v2/b8f478528a90485c91b363b57505a047/flavors/1 HTTP/1.1" status: 200 len: 615 time: 0.0232971
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions [req-7ff9a592-53b5-4334-9484-1c7bc22450ea 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] Unexpected exception in API method
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return f(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 611, in create
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions **create_kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 149, in inner
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions rv = f(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1581, in create
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions check_server_group_quota=check_server_group_quota)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1181, in _create_instance
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions auto_disk_config, reservation_id, max_count)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 955, in _validate_and_build_base_options
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions pci_request_info, requested_networks)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1059, in create_pci_requests_for_sriov_ports
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions neutron = get_client(context, admin=True)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 237, in get_client
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions auth_token = _ADMIN_AUTH.get_token(_SESSION)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 200, in get_token
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return self.get_access(session).auth_token
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 240, in get_access
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions self.auth_ref = self.get_auth_ref(session)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/generic/base.py", line 186, in get_auth_ref
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return self._plugin.get_auth_ref(session, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/v3/base.py", line 190, in get_auth_ref
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions authenticated=False, log=False, **rkwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 501, in post
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return self.request(url, 'POST', **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions return func(*args, **kwargs)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 401, in request
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions raise exceptions.from_response(resp, method, url)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions BadRequest: Expecting to find id or name in user - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-4f1bae96-73bf-4ccc-8519-174c8848a1c8)
2016-02-13 14:54:33.472 26962 ERROR nova.api.openstack.extensions
2016-02-13 14:54:33.477 26962 INFO nova.api.openstack.wsgi [req-7ff9a592-53b5-4334-9484-1c7bc22450ea 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneclient.exceptions.BadRequest'>
2016-02-13 14:54:33.479 26962 INFO nova.osapi_compute.wsgi.server [req-7ff9a592-53b5-4334-9484-1c7bc22450ea 4cc7915e0c8e4deb8cbd4e45fa912417 b8f478528a90485c91b363b57505a047 - - -] 192.168.2.50 "POST /v2/b8f478528a90485c91b363b57505a047/servers HTTP/1.1" status: 500 len: 441 time: 1.6943171
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1545313/+subscriptions
Follow ups
