yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1536513] [NEW] os-getConsoleOutput fail with 500

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Eli Qiao <liyong.qiao@xxxxxxxxx>
Date: Thu, 21 Jan 2016 07:55:16 -0000
Reply-to: Bug 1536513 <1536513@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

2016-01-21 07:12:24.667 DEBUG nova.api.openstack.wsgi [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] Action: 'action', calling method: <bound method ConsoleOutputController.get_console_output of <nova.api.openstack.compute.console_output.ConsoleOutputController object at 0x7f313d6cc410>>, body: {"os-getConsoleOutput": {}} _process_stack /opt/stack/new/nova/nova/api/openstack/wsgi.py:806
2016-01-21 07:12:24.668 DEBUG nova.compute.api [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] [instance: c2294c61-b6cf-4ffa-8e87-d382e0205235] Fetching instance by UUID get /opt/stack/new/nova/nova/compute/api.py:1945
2016-01-21 07:12:24.853 ERROR nova.api.openstack.extensions [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] Unexpected exception in API method
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/api/openstack/extensions.py", line 478, in wrapped
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/api/validation/__init__.py", line 73, in wrapper
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/api/openstack/compute/console_output.py", line 54, in get_console_output
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     length)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/api.py", line 171, in wrapped
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return func(self, context, target, *args, **kwargs)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/api.py", line 151, in wrapped
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return function(self, context, instance, *args, **kwargs)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/api.py", line 2917, in get_console_output
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     instance=instance, tail_length=tail_length)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/rpcapi.py", line 498, in get_console_output
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     instance=instance, tail_length=tail_length)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     retry=self.retry)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     timeout=timeout, retry=retry)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 464, in send
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     retry=retry)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 455, in _send
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     raise result
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions NovaException_Remote: Guest does not have a console available
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions Traceback (most recent call last):
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 143, in _dispatch_and_reply
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     executor_callback))
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 189, in _dispatch
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     executor_callback)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     result = func(ctxt, **new_args)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 150, in inner
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/exception.py", line 110, in wrapped
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     payload)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/exception.py", line 89, in wrapped
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return f(self, context, *args, **kw)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/manager.py", line 385, in decorated_function
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     kwargs['instance'], e, sys.exc_info())
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/manager.py", line 373, in decorated_function
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return function(self, context, *args, **kwargs)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/manager.py", line 4415, in get_console_output
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     output = self.driver.get_console_output(context, instance)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/virt/xenapi/driver.py", line 373, in get_console_output
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return self._vmops.get_console_output(instance)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/virt/xenapi/vmops.py", line 1773, in get_console_output
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     raise exception.NovaException(msg)
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions NovaException: Guest does not have a console available
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
2016-01-21 07:12:24.854 INFO nova.api.openstack.wsgi [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'NovaException_Remote'>
2016-01-21 07:12:24.855 DEBUG nova.api.openstack.wsgi [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
<class 'NovaException_Remote'> __call__ /opt/stack/new/nova/nova/api/openstack/wsgi.py:1191

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1536513

Title:
  os-getConsoleOutput fail with 500

Status in OpenStack Compute (nova):
  New

Bug description:
  2016-01-21 07:12:24.667 DEBUG nova.api.openstack.wsgi [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] Action: 'action', calling method: <bound method ConsoleOutputController.get_console_output of <nova.api.openstack.compute.console_output.ConsoleOutputController object at 0x7f313d6cc410>>, body: {"os-getConsoleOutput": {}} _process_stack /opt/stack/new/nova/nova/api/openstack/wsgi.py:806
  2016-01-21 07:12:24.668 DEBUG nova.compute.api [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] [instance: c2294c61-b6cf-4ffa-8e87-d382e0205235] Fetching instance by UUID get /opt/stack/new/nova/nova/compute/api.py:1945
  2016-01-21 07:12:24.853 ERROR nova.api.openstack.extensions [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] Unexpected exception in API method
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/api/openstack/extensions.py", line 478, in wrapped
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return f(*args, **kwargs)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/api/validation/__init__.py", line 73, in wrapper
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/api/openstack/compute/console_output.py", line 54, in get_console_output
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     length)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/api.py", line 171, in wrapped
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return func(self, context, target, *args, **kwargs)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/api.py", line 151, in wrapped
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return function(self, context, instance, *args, **kwargs)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/api.py", line 2917, in get_console_output
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     instance=instance, tail_length=tail_length)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/rpcapi.py", line 498, in get_console_output
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     instance=instance, tail_length=tail_length)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 158, in call
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     retry=self.retry)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     timeout=timeout, retry=retry)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 464, in send
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     retry=retry)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 455, in _send
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     raise result
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions NovaException_Remote: Guest does not have a console available
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions Traceback (most recent call last):
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 143, in _dispatch_and_reply
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     executor_callback))
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 189, in _dispatch
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     executor_callback)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 130, in _do_dispatch
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     result = func(ctxt, **new_args)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 150, in inner
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return func(*args, **kwargs)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/exception.py", line 110, in wrapped
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     payload)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/exception.py", line 89, in wrapped
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return f(self, context, *args, **kw)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/manager.py", line 385, in decorated_function
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     kwargs['instance'], e, sys.exc_info())
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 204, in __exit__
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     six.reraise(self.type_, self.value, self.tb)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/manager.py", line 373, in decorated_function
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return function(self, context, *args, **kwargs)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/compute/manager.py", line 4415, in get_console_output
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     output = self.driver.get_console_output(context, instance)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/virt/xenapi/driver.py", line 373, in get_console_output
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     return self._vmops.get_console_output(instance)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions   File "/opt/stack/new/nova/nova/virt/xenapi/vmops.py", line 1773, in get_console_output
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions     raise exception.NovaException(msg)
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions NovaException: Guest does not have a console available
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.853 12292 ERROR nova.api.openstack.extensions 
  2016-01-21 07:12:24.854 INFO nova.api.openstack.wsgi [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] HTTP exception thrown: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'NovaException_Remote'>
  2016-01-21 07:12:24.855 DEBUG nova.api.openstack.wsgi [req-62cccfc1-478e-415b-8f12-51637bfd78e7 tempest-ServerActionsTestJSON-1139043036 tempest-ServerActionsTestJSON-2088121350] Returning 500 to user: Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible.
  <class 'NovaException_Remote'> __call__ /opt/stack/new/nova/nova/api/openstack/wsgi.py:1191

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1536513/+subscriptions
Follow ups

[Bug 1536513] Re: os-getConsoleOutput fail with 500
From: OpenStack Infra, 2016-03-10