← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1610887] [NEW] Error while launching instance. ERROR (ClientException): Unexpected API Error.

 

Public bug reported:

I'm unable to launch instance using nova boot command.
I'm running openstack liberty on Ubuntu Server 14 VMs on virtual box in a multi-node set-up. Following official docs for liberty on ubuntu.
Below are command and error details, nova-api.log and nova-compute.log lines and my nova.conf contenets.

Command and Error;
root@controller:~# nova boot --flavor m1.tiny --image cirros --nic net-id=aaa59963-a3b2-4c37-b691-5a0369b6ffde \
> --security-group default --key-name mykey vm1
ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneclient.exceptions.BadRequest'> (HTTP 500) (Request-ID: req-91af2d4b-8948-476e-b87a-00c34598dde7)


Error log in 'Nova-api.log' file;

2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions     return self.request(url, 'POST', **kwargs)
2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/keystoneclient/utils.py", line 337, in inner
2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py", line 401, in request
2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions     raise exceptions.from_response(resp, method, url)
2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3265697b-246a-4596-8e35-348e4f36a671)
2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions
2016-08-08 12:30:41.291 4992 INFO nova.api.openstack.wsgi [req-91af2d4b-8948-476e-b87a-00c34598dde7 fd2b20887e9847bf80d84ee31e47aec9 61544fe6c61040cc98ba2c636cb0f889 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'keystoneclient.exceptions.BadRequest'>
2016-08-08 12:30:41.322 4992 INFO nova.osapi_compute.wsgi.server [req-91af2d4b-8948-476e-b87a-00c34598dde7 fd2b20887e9847bf80d84ee31e47aec9 61544fe6c61040cc98ba2c636cb0f889 - - -] 10.1.1.21 "POST /v2/61544fe6c61040cc98ba2c636cb0f889/servers HTTP/1.1" status: 500 len: 441 time: 2.0076089


Error in nova-compute.log on compute noce;
2016-08-08 11:41:25.074 1581 ERROR oslo.messaging._drivers.impl_rabbit [req-cddbd2fb-f356-4d84-823b-a9703fc70751 - - - - -] AMQP server on controller:5672 is unreachable: timed out. Trying again in 2 seconds.


Below is my /etc/nova/nova.conf file on controller;
[DEFAULT]
dhcpbridge_flagfile=/etc/nova/nova.conf
dhcpbridge=/usr/bin/nova-dhcpbridge
logdir=/var/log/nova
state_path=/var/lib/nova
lock_path=/var/lock/nova
force_dhcp_release=True
libvirt_use_virtio_for_bridges=True
#verbose=True
ec2_private_dns_show_ip=True
api_paste_config=/etc/nova/api-paste.ini
#enabled_apis=ec2,osapi_compute,metadata

rpc_backend = rabbit

auth_strategy = keystone

my_ip = <controller IP>

network_api_class = nova.network.neutronv2.api.API
security_group_api = neutron
linuxnet_interface_driver = nova.network.linux_net.NeutronLinuxBridgeInterfaceDriver
firewall_driver = nova.virt.firewall.NoopFirewallDriver

enabled_apis=osapi_compute,metadata

verbose = True

[database]
connection = mysql+pymysql://nova:nova@controller/nova


[oslo_messaging_rabbit]
rabbit_host = controller
rabbit_userid = openstack
rabbit_password = <pwd>


[keystone_authtoken]
auth_uri = http://controller:5000
#identity_url = http://controller:35357
auth_host = controller
auth_port = 35357
auth_protocol = http
#auth_plugin = password
admin_tenant_name = service
admin_user = nova
admin_password = <pwd>
#auth_plugin = password
#project_domain_id = default
#user_domain_id = default
#project_name = service
#username = nova
#password = nova

[vnc]
vncserver_listen = $my_ip
vncserver_proxyclient_address = $my_ip

[glance]
host = controller

[oslo_concurrency]
lock_path = /var/lib/nova/tmp

[neutron]
#identity_url = http://controller:35357
url = http://controller:9696
#auth_strategy = keystone
auth_host = controller
auth_port = 35357
auth_protocol = http
#auth_plugin = password
#project_domain_id = default
#user_domain_id = default
auth_region = RegionOne
admin_tenant_name = service
admin_user = neutron
admin_password = <pwd>
#url = http://controller:9696

service_metadata_proxy = True
metadata_proxy_shared_secret = <METADATA_SECRET>

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1610887

Title:
  Error while launching instance. ERROR (ClientException): Unexpected
  API Error.

Status in OpenStack Compute (nova):
  New

Bug description:
  I'm unable to launch instance using nova boot command.
  I'm running openstack liberty on Ubuntu Server 14 VMs on virtual box in a multi-node set-up. Following official docs for liberty on ubuntu.
  Below are command and error details, nova-api.log and nova-compute.log lines and my nova.conf contenets.

  Command and Error;
  root@controller:~# nova boot --flavor m1.tiny --image cirros --nic net-id=aaa59963-a3b2-4c37-b691-5a0369b6ffde \
  > --security-group default --key-name mykey vm1
  ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'keystoneclient.exceptions.BadRequest'> (HTTP 500) (Request-ID: req-91af2d4b-8948-476e-b87a-00c34598dde7)

  
  Error log in 'Nova-api.log' file;

  2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions     return self.request(url, 'POST', **kwargs)
  2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/keystoneclient/utils.py", line 337, in inner
  2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions   File "/usr/lib/python2.7/dist-packages/keystoneclient/session.py", line 401, in request
  2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions     raise exceptions.from_response(resp, method, url)
  2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions BadRequest: Expecting to find username or userId in passwordCredentials - the server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. (HTTP 400) (Request-ID: req-3265697b-246a-4596-8e35-348e4f36a671)
  2016-08-08 12:30:41.195 4992 ERROR nova.api.openstack.extensions
  2016-08-08 12:30:41.291 4992 INFO nova.api.openstack.wsgi [req-91af2d4b-8948-476e-b87a-00c34598dde7 fd2b20887e9847bf80d84ee31e47aec9 61544fe6c61040cc98ba2c636cb0f889 - - -] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'keystoneclient.exceptions.BadRequest'>
  2016-08-08 12:30:41.322 4992 INFO nova.osapi_compute.wsgi.server [req-91af2d4b-8948-476e-b87a-00c34598dde7 fd2b20887e9847bf80d84ee31e47aec9 61544fe6c61040cc98ba2c636cb0f889 - - -] 10.1.1.21 "POST /v2/61544fe6c61040cc98ba2c636cb0f889/servers HTTP/1.1" status: 500 len: 441 time: 2.0076089

  
  Error in nova-compute.log on compute noce;
  2016-08-08 11:41:25.074 1581 ERROR oslo.messaging._drivers.impl_rabbit [req-cddbd2fb-f356-4d84-823b-a9703fc70751 - - - - -] AMQP server on controller:5672 is unreachable: timed out. Trying again in 2 seconds.

  
  Below is my /etc/nova/nova.conf file on controller;
  [DEFAULT]
  dhcpbridge_flagfile=/etc/nova/nova.conf
  dhcpbridge=/usr/bin/nova-dhcpbridge
  logdir=/var/log/nova
  state_path=/var/lib/nova
  lock_path=/var/lock/nova
  force_dhcp_release=True
  libvirt_use_virtio_for_bridges=True
  #verbose=True
  ec2_private_dns_show_ip=True
  api_paste_config=/etc/nova/api-paste.ini
  #enabled_apis=ec2,osapi_compute,metadata

  rpc_backend = rabbit

  auth_strategy = keystone

  my_ip = <controller IP>

  network_api_class = nova.network.neutronv2.api.API
  security_group_api = neutron
  linuxnet_interface_driver = nova.network.linux_net.NeutronLinuxBridgeInterfaceDriver
  firewall_driver = nova.virt.firewall.NoopFirewallDriver

  enabled_apis=osapi_compute,metadata

  verbose = True

  [database]
  connection = mysql+pymysql://nova:nova@controller/nova

  
  [oslo_messaging_rabbit]
  rabbit_host = controller
  rabbit_userid = openstack
  rabbit_password = <pwd>

  
  [keystone_authtoken]
  auth_uri = http://controller:5000
  #identity_url = http://controller:35357
  auth_host = controller
  auth_port = 35357
  auth_protocol = http
  #auth_plugin = password
  admin_tenant_name = service
  admin_user = nova
  admin_password = <pwd>
  #auth_plugin = password
  #project_domain_id = default
  #user_domain_id = default
  #project_name = service
  #username = nova
  #password = nova

  [vnc]
  vncserver_listen = $my_ip
  vncserver_proxyclient_address = $my_ip

  [glance]
  host = controller

  [oslo_concurrency]
  lock_path = /var/lib/nova/tmp

  [neutron]
  #identity_url = http://controller:35357
  url = http://controller:9696
  #auth_strategy = keystone
  auth_host = controller
  auth_port = 35357
  auth_protocol = http
  #auth_plugin = password
  #project_domain_id = default
  #user_domain_id = default
  auth_region = RegionOne
  admin_tenant_name = service
  admin_user = neutron
  admin_password = <pwd>
  #url = http://controller:9696

  service_metadata_proxy = True
  metadata_proxy_shared_secret = <METADATA_SECRET>

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1610887/+subscriptions


Follow ups