yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1752210] [NEW] Counter A ERROR when nova creates instance

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: wangthes <1752210@xxxxxxxxxxxxxxxxxx>
Date: Wed, 28 Feb 2018 01:52:35 -0000
Reply-to: Bug 1752210 <1752210@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

[root@controller0 ~]# . demo-openrc 
[root@controller0 ~]# openstack server create --flavor m1.tiny --image 2af953de-058a-49a9-825d-781d220cd6eb --nic net-id=69d9c6d9-7716-45f1-a8d8-8988b59440af --security-group default demo-instance
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneclient.exceptions.BadRequest'> (HTTP 500) (Request-ID: req-4de93f56-1506-401e-a602-9fa5aa162824)

[root@controller0 ~]# tail -n 50 /var/log/nova/nova-api.log |grep ERROR
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions [req-4de93f56-1506-401e-a602-9fa5aa162824 d3eedc4b1e0348f0865b6a8052f75bd1 1ec04ee805f24681a6a37cf0b6e52970 - - -] Unexpected exception in API method
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 611, in create
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     **create_kwargs)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 149, in inner
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     rv = f(*args, **kwargs)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1587, in create
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     check_server_group_quota=check_server_group_quota)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1187, in _create_instance
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     auto_disk_config, reservation_id, max_count)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 961, in _validate_and_build_base_options
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     pci_request_info, requested_networks)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1092, in create_pci_requests_for_sriov_ports
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     neutron = get_client(context, admin=True)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 237, in get_client
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     auth_token = _ADMIN_AUTH.get_token(_SESSION)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 200, in get_token
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return self.get_access(session).auth_token
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 240, in get_access
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     self.auth_ref = self.get_auth_ref(session)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/v2.py", line 88, in get_auth_ref
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     authenticated=False, log=False)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 501, in post
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return self.request(url, 'POST', **kwargs)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 401, in request
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     raise exceptions.from_response(resp, method, url)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-718bb31d-0101-4ed4-bdf9-aa3f2642f84e)
2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: keystone nova

** Tags added: nova

** Tags added: keystone

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1752210

Title:
  Counter A ERROR when nova creates instance

Status in OpenStack Compute (nova):
  New

Bug description:
  [root@controller0 ~]# . demo-openrc 
  [root@controller0 ~]# openstack server create --flavor m1.tiny --image 2af953de-058a-49a9-825d-781d220cd6eb --nic net-id=69d9c6d9-7716-45f1-a8d8-8988b59440af --security-group default demo-instance
  Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'keystoneclient.exceptions.BadRequest'> (HTTP 500) (Request-ID: req-4de93f56-1506-401e-a602-9fa5aa162824)

  [root@controller0 ~]# tail -n 50 /var/log/nova/nova-api.log |grep ERROR
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions [req-4de93f56-1506-401e-a602-9fa5aa162824 d3eedc4b1e0348f0865b6a8052f75bd1 1ec04ee805f24681a6a37cf0b6e52970 - - -] Unexpected exception in API method
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/extensions.py", line 478, in wrapped
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/validation/__init__.py", line 73, in wrapper
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/api/openstack/compute/servers.py", line 611, in create
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     **create_kwargs)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 149, in inner
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     rv = f(*args, **kwargs)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1587, in create
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     check_server_group_quota=check_server_group_quota)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 1187, in _create_instance
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     auto_disk_config, reservation_id, max_count)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/compute/api.py", line 961, in _validate_and_build_base_options
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     pci_request_info, requested_networks)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 1092, in create_pci_requests_for_sriov_ports
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     neutron = get_client(context, admin=True)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/nova/network/neutronv2/api.py", line 237, in get_client
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     auth_token = _ADMIN_AUTH.get_token(_SESSION)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 200, in get_token
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return self.get_access(session).auth_token
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/base.py", line 240, in get_access
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     self.auth_ref = self.get_auth_ref(session)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/auth/identity/v2.py", line 88, in get_auth_ref
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     authenticated=False, log=False)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 501, in post
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return self.request(url, 'POST', **kwargs)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/utils.py", line 337, in inner
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/site-packages/keystoneclient/session.py", line 401, in request
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions     raise exceptions.from_response(resp, method, url)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-718bb31d-0101-4ed4-bdf9-aa3f2642f84e)
  2018-02-27 20:50:57.551 1598 ERROR nova.api.openstack.extensions

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1752210/+subscriptions
Follow ups

[Bug 1752210] Re: Counter A ERROR when nova creates instance
From: Matt Riedemann, 2018-03-21