yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1709747] [NEW] HTTP exception thrown: Unexpected API Error.

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Guo shuaijie <1709747@xxxxxxxxxxxxxxxxxx>
Date: Thu, 10 Aug 2017 02:13:00 -0000
Reply-to: Bug 1709747 <1709747@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions [None req-03396686-9700-4323-b7e5-1054fcc167d2 alt_demo admin] Unexpected exception in API method: MessagingTimeout: Timed out waiting for a reply to message ID d5abd16bee8846eaa764440df982bfab
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions Traceback (most recent call last):
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/api/openstack/extensions.py", line 336, in wrapped
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/api/validation/__init__.py", line 108, in wrapper
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/api/openstack/compute/remote_consoles.py", line 82, in get_spice_console
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     console_type)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/compute/api.py", line 192, in wrapped
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     return function(self, context, instance, *args, **kwargs)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/compute/api.py", line 182, in inner
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     return f(self, context, instance, *args, **kw)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/compute/api.py", line 3599, in get_spice_console
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     instance=instance, console_type=console_type)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/compute/rpcapi.py", line 614, in get_spice_console
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     instance=instance, console_type=console_type)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     retry=self.retry)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 123, in _send
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     timeout=timeout, retry=retry)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 578, in send
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     retry=retry)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 567, in _send
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     result = self._waiter.wait(msg_id, timeout)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 459, in wait
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     message = self.waiters.get(msg_id, timeout=timeout)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 347, in get
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     'to message ID %s' % msg_id)
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions MessagingTimeout: Timed out waiting for a reply to message ID d5abd16bee8846eaa764440df982bfab
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions 
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: INFO nova.api.openstack.wsgi [None req-03396686-9700-4323-b7e5-1054fcc167d2 alt_demo admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: <class 'oslo_messaging.exceptions.MessagingTimeout'>: HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: <class 'oslo_messaging.exceptions.MessagingTimeout'>
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: DEBUG nova.api.openstack.wsgi [None req-03396686-9700-4323-b7e5-1054fcc167d2 alt_demo admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: <class 'oslo_messaging.exceptions.MessagingTimeout'> {{(pid=8810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:1029}}
Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: [pid: 8810|app: 0|req: 14/25] 192.168.22.81 () {64 vars in 1382 bytes} [Thu Aug 10 10:07:12 2017] POST /compute/v2.1/servers/cd49a0d1-2ae8-4f24-94ef-06eeef42a39c/action => generated 216 bytes in 60219 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0)

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1709747

Title:
  HTTP exception thrown: Unexpected API Error.

Status in OpenStack Compute (nova):
  New

Bug description:
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions [None req-03396686-9700-4323-b7e5-1054fcc167d2 alt_demo admin] Unexpected exception in API method: MessagingTimeout: Timed out waiting for a reply to message ID d5abd16bee8846eaa764440df982bfab
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions Traceback (most recent call last):
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/api/openstack/extensions.py", line 336, in wrapped
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/api/validation/__init__.py", line 108, in wrapper
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/api/openstack/compute/remote_consoles.py", line 82, in get_spice_console
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     console_type)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/compute/api.py", line 192, in wrapped
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     return function(self, context, instance, *args, **kwargs)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/compute/api.py", line 182, in inner
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     return f(self, context, instance, *args, **kw)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/compute/api.py", line 3599, in get_spice_console
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     instance=instance, console_type=console_type)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/opt/stack/nova/nova/compute/rpcapi.py", line 614, in get_spice_console
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     instance=instance, console_type=console_type)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     retry=self.retry)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 123, in _send
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     timeout=timeout, retry=retry)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 578, in send
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     retry=retry)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 567, in _send
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     result = self._waiter.wait(msg_id, timeout)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 459, in wait
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     message = self.waiters.get(msg_id, timeout=timeout)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 347, in get
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions     'to message ID %s' % msg_id)
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions MessagingTimeout: Timed out waiting for a reply to message ID d5abd16bee8846eaa764440df982bfab
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: ERROR nova.api.openstack.extensions 
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: INFO nova.api.openstack.wsgi [None req-03396686-9700-4323-b7e5-1054fcc167d2 alt_demo admin] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: <class 'oslo_messaging.exceptions.MessagingTimeout'>: HTTPInternalServerError: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: <class 'oslo_messaging.exceptions.MessagingTimeout'>
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: DEBUG nova.api.openstack.wsgi [None req-03396686-9700-4323-b7e5-1054fcc167d2 alt_demo admin] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: <class 'oslo_messaging.exceptions.MessagingTimeout'> {{(pid=8810) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:1029}}
  Aug 10 10:08:12 ubuntudbs devstack@n-api.service[8770]: [pid: 8810|app: 0|req: 14/25] 192.168.22.81 () {64 vars in 1382 bytes} [Thu Aug 10 10:07:12 2017] POST /compute/v2.1/servers/cd49a0d1-2ae8-4f24-94ef-06eeef42a39c/action => generated 216 bytes in 60219 msecs (HTTP/1.1 500) 9 headers in 391 bytes (1 switches on core 0)

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1709747/+subscriptions
Follow ups

[Bug 1709747] Re: 500 error MessagingTimeout from API when getting SPICE console
From: Guo shuaijie, 2017-08-10
[Bug 1709747] Re: HTTP exception thrown: Unexpected API Error.
From: Matt Riedemann, 2017-08-10
[Bug 1709747] Re: HTTP exception thrown: Unexpected API Error.
From: Matt Riedemann, 2017-08-10