← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1803861] [NEW] Unexpected API Error.

 

Public bug reported:

Description
===========
ClientException: Unexpected API Error has returned when I perform below command:
$ openstack console url show provider-instance

Steps to reproduce
==================
* I following Rocky install-guide for Ubuntu. then I did  perform above command after the instance launched for access virtual console.
  (https://docs.openstack.org/install-guide/launch-instance-provider.html)

For further investigating, openstack client command with debug option
like below.

---
REQ: curl -g -i -X POST http://CONTROLLER:8774/v2.1/servers/0892b6b0-15b9-4ee9-bd72-6ea124e36721/action -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA1}ce0fa2f294403fb0799374c146609be3328d2006" -d '{"os-getVNCConsole": {"type": "novnc"}}'
http://CONTROLLER:8774 "POST /v2.1/servers/0892b6b0-15b9-4ee9-bd72-6ea124e36721/action HTTP/1.1" 500 216
RESP: [500] Connection: keep-alive Content-Length: 216 Content-Type: application/json; charset=UTF-8 Date: Sun, 18 Nov 2018 10:56:58 GMT Openstack-Api-Version: compute 2.1 Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-0485f3c1-155b-4000-9474-6197a7039577 X-Openstack-Nova-Api-Version: 2.1 X-Openstack-Request-Id: req-0485f3c1-155b-4000-9474-6197a7039577
RESP BODY: {"computeFault": {"message": "Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.\n<class 'oslo_messaging.exceptions.MessagingTimeout'>", "code": 500}}
POST call to compute for http://CONTROLLER:8774/v2.1/servers/0892b6b0-15b9-4ee9-bd72-6ea124e36721/action used request id req-0485f3c1-155b-4000-9474-6197a7039577
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-0485f3c1-155b-4000-9474-6197a7039577)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/cliff/app.py", line 400, in run_subcommand
    result = cmd.run(parsed_args)
  File "/usr/lib/python2.7/dist-packages/osc_lib/command/command.py", line 41, in run
    return super(Command, self).run(parsed_args)
  File "/usr/lib/python2.7/dist-packages/cliff/display.py", line 116, in run
    column_names, data = self.take_action(parsed_args)
  File "/usr/lib/python2.7/dist-packages/openstackclient/compute/v2/console.py", line 130, in take_action
    data = server.get_console_url(parsed_args.url_type)
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 147, in get_console_url
    return self.manager.get_console_url(self, console_type)
  File "/usr/lib/python2.7/dist-packages/novaclient/api_versions.py", line 393, in substitution
    return methods[-1].func(obj, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 931, in get_console_url
    return self._action(action, server, {'type': console_type})
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1918, in _action
    info=info, **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1929, in _action_return_resp_and_body
    return self.api.client.post(url, body=body)
  File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 334, in post
    return self.request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 83, in request
    raise exceptions.from_response(resp, body, url, method)
ClientException: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-0485f3c1-155b-4000-9474-6197a7039577)
clean_up ShowConsoleURL: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-0485f3c1-155b-4000-9474-6197a7039577)
Traceback (most recent call last):
  File "/usr/lib/python2.7/dist-packages/osc_lib/shell.py", line 135, in run
    ret_val = super(OpenStackShell, self).run(argv)
  File "/usr/lib/python2.7/dist-packages/cliff/app.py", line 279, in run
    result = self.run_subcommand(remainder)
  File "/usr/lib/python2.7/dist-packages/osc_lib/shell.py", line 175, in run_subcommand
    ret_value = super(OpenStackShell, self).run_subcommand(argv)
  File "/usr/lib/python2.7/dist-packages/cliff/app.py", line 400, in run_subcommand
    result = cmd.run(parsed_args)
  File "/usr/lib/python2.7/dist-packages/osc_lib/command/command.py", line 41, in run
    return super(Command, self).run(parsed_args)
  File "/usr/lib/python2.7/dist-packages/cliff/display.py", line 116, in run
    column_names, data = self.take_action(parsed_args)
  File "/usr/lib/python2.7/dist-packages/openstackclient/compute/v2/console.py", line 130, in take_action
    data = server.get_console_url(parsed_args.url_type)
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 147, in get_console_url
    return self.manager.get_console_url(self, console_type)
  File "/usr/lib/python2.7/dist-packages/novaclient/api_versions.py", line 393, in substitution
    return methods[-1].func(obj, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 931, in get_console_url
    return self._action(action, server, {'type': console_type})
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1918, in _action
    info=info, **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1929, in _action_return_resp_and_body
    return self.api.client.post(url, body=body)
  File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 334, in post
    return self.request(url, 'POST', **kwargs)
  File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 83, in request
    raise exceptions.from_response(resp, body, url, method)
ClientException: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-0485f3c1-155b-4000-9474-6197a7039577)

END return value: 1
---

Expected result
===============
The VNC session url returns correctly like below.
+-------+---------------------------------------------------------------------------------+
| Field | Value                                                                           |
+-------+---------------------------------------------------------------------------------+
| type  | novnc                                                                           |
| url   | http://controller:6080/vnc_auto.html?token=5eeccb47-525c-4918-ac2a-3ad1e9f1f493 |
+-------+---------------------------------------------------------------------------------+

Actual result
=============
daisuke@CONTROLLER:~$ openstack console url show provider-instance
Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-7b87ecf0-ae23-4190-a8fc-8d8ce6b1fe17)

Environment
===========
1. Exact version of OpenStack you are running. See the following
  list for all releases: http://docs.openstack.org/releases/

$ dpkg -l | grep nova
ii  nova-api                              2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - API frontend
ii  nova-common                           2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - common files
rc  nova-compute-kvm                      2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - compute node (KVM)
ii  nova-conductor                        2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - conductor service
ii  nova-novncproxy                       2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - NoVNC proxy
ii  nova-placement-api                    2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - placement API frontend
ii  nova-scheduler                        2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - virtual machine scheduler
ii  python-nova                           2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute Python 2 libraries
ii  python-novaclient                     2:11.0.0-0ubuntu1~cloud0               all          client library for OpenStack Compute API - Python 2.7

2. Which hypervisor did you use?
Libvirt + KVM

$ dpkg -l | grep libvirt
ii  libvirt-clients                       4.0.0-1ubuntu8.5                       amd64        Programs for the libvirt library
ii  libvirt-daemon                        4.0.0-1ubuntu8.5                       amd64        Virtualization daemon
ii  libvirt-daemon-driver-storage-rbd     4.0.0-1ubuntu8.5                       amd64        Virtualization daemon RBD storage driver
ii  libvirt-daemon-system                 4.0.0-1ubuntu8.5                       amd64        Libvirt daemon configuration files
ii  libvirt0:amd64                        4.0.0-1ubuntu8.5                       amd64        library for interfacing with different virtualization systems
ii  nova-compute-libvirt                  2:17.0.6-0ubuntu1                      all          OpenStack Compute - compute node libvirt support
ii  python-libvirt                        4.0.0-1                                amd64        libvirt Python bindings

$ dpkg -l | grep kvm
ii  nova-compute-kvm                      2:17.0.6-0ubuntu1                      all          OpenStack Compute - compute node (KVM)
ii  qemu-kvm                              1:2.11+dfsg-1ubuntu7.7                 amd64        QEMU Full virtualization on x86 hardware

2. Which storage type did you use?
ext4 (ubuntu 18.04 default)

3. Which networking type did you use?
Neutron

Logs & Configs
sosreport attached.

Regards,
Daisuke Ota

** Affects: nova
     Importance: Undecided
         Status: New

** Attachment added: "sosreport"
   https://bugs.launchpad.net/bugs/1803861/+attachment/5213892/+files/sosreport-vm-nfj-oscompn1-20181118105447.tar.xz

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1803861

Title:
  Unexpected API Error.

Status in OpenStack Compute (nova):
  New

Bug description:
  Description
  ===========
  ClientException: Unexpected API Error has returned when I perform below command:
  $ openstack console url show provider-instance

  Steps to reproduce
  ==================
  * I following Rocky install-guide for Ubuntu. then I did  perform above command after the instance launched for access virtual console.
    (https://docs.openstack.org/install-guide/launch-instance-provider.html)

  For further investigating, openstack client command with debug option
  like below.

  ---
  REQ: curl -g -i -X POST http://CONTROLLER:8774/v2.1/servers/0892b6b0-15b9-4ee9-bd72-6ea124e36721/action -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA1}ce0fa2f294403fb0799374c146609be3328d2006" -d '{"os-getVNCConsole": {"type": "novnc"}}'
  http://CONTROLLER:8774 "POST /v2.1/servers/0892b6b0-15b9-4ee9-bd72-6ea124e36721/action HTTP/1.1" 500 216
  RESP: [500] Connection: keep-alive Content-Length: 216 Content-Type: application/json; charset=UTF-8 Date: Sun, 18 Nov 2018 10:56:58 GMT Openstack-Api-Version: compute 2.1 Vary: OpenStack-API-Version, X-OpenStack-Nova-API-Version X-Compute-Request-Id: req-0485f3c1-155b-4000-9474-6197a7039577 X-Openstack-Nova-Api-Version: 2.1 X-Openstack-Request-Id: req-0485f3c1-155b-4000-9474-6197a7039577
  RESP BODY: {"computeFault": {"message": "Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.\n<class 'oslo_messaging.exceptions.MessagingTimeout'>", "code": 500}}
  POST call to compute for http://CONTROLLER:8774/v2.1/servers/0892b6b0-15b9-4ee9-bd72-6ea124e36721/action used request id req-0485f3c1-155b-4000-9474-6197a7039577
  Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-0485f3c1-155b-4000-9474-6197a7039577)
  Traceback (most recent call last):
    File "/usr/lib/python2.7/dist-packages/cliff/app.py", line 400, in run_subcommand
      result = cmd.run(parsed_args)
    File "/usr/lib/python2.7/dist-packages/osc_lib/command/command.py", line 41, in run
      return super(Command, self).run(parsed_args)
    File "/usr/lib/python2.7/dist-packages/cliff/display.py", line 116, in run
      column_names, data = self.take_action(parsed_args)
    File "/usr/lib/python2.7/dist-packages/openstackclient/compute/v2/console.py", line 130, in take_action
      data = server.get_console_url(parsed_args.url_type)
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 147, in get_console_url
      return self.manager.get_console_url(self, console_type)
    File "/usr/lib/python2.7/dist-packages/novaclient/api_versions.py", line 393, in substitution
      return methods[-1].func(obj, *args, **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 931, in get_console_url
      return self._action(action, server, {'type': console_type})
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1918, in _action
      info=info, **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1929, in _action_return_resp_and_body
      return self.api.client.post(url, body=body)
    File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 334, in post
      return self.request(url, 'POST', **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 83, in request
      raise exceptions.from_response(resp, body, url, method)
  ClientException: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-0485f3c1-155b-4000-9474-6197a7039577)
  clean_up ShowConsoleURL: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-0485f3c1-155b-4000-9474-6197a7039577)
  Traceback (most recent call last):
    File "/usr/lib/python2.7/dist-packages/osc_lib/shell.py", line 135, in run
      ret_val = super(OpenStackShell, self).run(argv)
    File "/usr/lib/python2.7/dist-packages/cliff/app.py", line 279, in run
      result = self.run_subcommand(remainder)
    File "/usr/lib/python2.7/dist-packages/osc_lib/shell.py", line 175, in run_subcommand
      ret_value = super(OpenStackShell, self).run_subcommand(argv)
    File "/usr/lib/python2.7/dist-packages/cliff/app.py", line 400, in run_subcommand
      result = cmd.run(parsed_args)
    File "/usr/lib/python2.7/dist-packages/osc_lib/command/command.py", line 41, in run
      return super(Command, self).run(parsed_args)
    File "/usr/lib/python2.7/dist-packages/cliff/display.py", line 116, in run
      column_names, data = self.take_action(parsed_args)
    File "/usr/lib/python2.7/dist-packages/openstackclient/compute/v2/console.py", line 130, in take_action
      data = server.get_console_url(parsed_args.url_type)
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 147, in get_console_url
      return self.manager.get_console_url(self, console_type)
    File "/usr/lib/python2.7/dist-packages/novaclient/api_versions.py", line 393, in substitution
      return methods[-1].func(obj, *args, **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 931, in get_console_url
      return self._action(action, server, {'type': console_type})
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1918, in _action
      info=info, **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/v2/servers.py", line 1929, in _action_return_resp_and_body
      return self.api.client.post(url, body=body)
    File "/usr/lib/python2.7/dist-packages/keystoneauth1/adapter.py", line 334, in post
      return self.request(url, 'POST', **kwargs)
    File "/usr/lib/python2.7/dist-packages/novaclient/client.py", line 83, in request
      raise exceptions.from_response(resp, body, url, method)
  ClientException: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-0485f3c1-155b-4000-9474-6197a7039577)

  END return value: 1
  ---

  Expected result
  ===============
  The VNC session url returns correctly like below.
  +-------+---------------------------------------------------------------------------------+
  | Field | Value                                                                           |
  +-------+---------------------------------------------------------------------------------+
  | type  | novnc                                                                           |
  | url   | http://controller:6080/vnc_auto.html?token=5eeccb47-525c-4918-ac2a-3ad1e9f1f493 |
  +-------+---------------------------------------------------------------------------------+

  Actual result
  =============
  daisuke@CONTROLLER:~$ openstack console url show provider-instance
  Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-7b87ecf0-ae23-4190-a8fc-8d8ce6b1fe17)

  Environment
  ===========
  1. Exact version of OpenStack you are running. See the following
    list for all releases: http://docs.openstack.org/releases/

  $ dpkg -l | grep nova
  ii  nova-api                              2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - API frontend
  ii  nova-common                           2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - common files
  rc  nova-compute-kvm                      2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - compute node (KVM)
  ii  nova-conductor                        2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - conductor service
  ii  nova-novncproxy                       2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - NoVNC proxy
  ii  nova-placement-api                    2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - placement API frontend
  ii  nova-scheduler                        2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute - virtual machine scheduler
  ii  python-nova                           2:18.0.1-0ubuntu1~cloud0               all          OpenStack Compute Python 2 libraries
  ii  python-novaclient                     2:11.0.0-0ubuntu1~cloud0               all          client library for OpenStack Compute API - Python 2.7

  2. Which hypervisor did you use?
  Libvirt + KVM

  $ dpkg -l | grep libvirt
  ii  libvirt-clients                       4.0.0-1ubuntu8.5                       amd64        Programs for the libvirt library
  ii  libvirt-daemon                        4.0.0-1ubuntu8.5                       amd64        Virtualization daemon
  ii  libvirt-daemon-driver-storage-rbd     4.0.0-1ubuntu8.5                       amd64        Virtualization daemon RBD storage driver
  ii  libvirt-daemon-system                 4.0.0-1ubuntu8.5                       amd64        Libvirt daemon configuration files
  ii  libvirt0:amd64                        4.0.0-1ubuntu8.5                       amd64        library for interfacing with different virtualization systems
  ii  nova-compute-libvirt                  2:17.0.6-0ubuntu1                      all          OpenStack Compute - compute node libvirt support
  ii  python-libvirt                        4.0.0-1                                amd64        libvirt Python bindings

  $ dpkg -l | grep kvm
  ii  nova-compute-kvm                      2:17.0.6-0ubuntu1                      all          OpenStack Compute - compute node (KVM)
  ii  qemu-kvm                              1:2.11+dfsg-1ubuntu7.7                 amd64        QEMU Full virtualization on x86 hardware

  2. Which storage type did you use?
  ext4 (ubuntu 18.04 default)

  3. Which networking type did you use?
  Neutron

  Logs & Configs
  sosreport attached.

  Regards,
  Daisuke Ota

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1803861/+subscriptions


Follow ups