yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1317174] [NEW] novnc console failure after Icehouse upgrade

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Adam Huffman <adam.huffman@xxxxxxxxx>
Date: Wed, 07 May 2014 16:27:08 -0000
Reply-to: Bug 1317174 <1317174@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

After upgrading my Havana installation to Icehouse, VNC console logins
are no longer working (1006 error).

The version in use is:

openstack-nova-novncproxy-2014.1-2.el6.noarch

from RDO.

This is the full error in the logs:

2014-05-07 17:12:58.003 13074 AUDIT nova.consoleauth.manager [req-684f9e8d-3c0a-4647-aa66-44f0bb35c4df None None] Checking Token: dbbd1b9b-002f-46b6-bf79-0d90e92c034e, True
2014-05-07 17:12:58.112 13074 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: tuple index out of range
Traceback (most recent call last):

  File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
    incoming.message))

  File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
    result = getattr(endpoint, method)(ctxt, **new_args)

  File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/server.py", line 139, in inner
    return func(*args, **kwargs)

  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 390, in decorated_function
    args = (_load_instance(args[0]),) + args[1:]

IndexError: tuple index out of range
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/nova/consoleauth/manager.py", line 117, in check_token
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     if self._validate_token(context, token):
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/nova/consoleauth/manager.py", line 108, in _validate_token
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     token['console_type'])
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/nova/compute/rpcapi.py", line 506, in validate_console_port
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     console_type=console_type)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/client.py", line 150, in call
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     wait_for_reply=True, timeout=timeout)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/transport.py", line 90, in _send
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     timeout=timeout)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     return self._send(target, ctxt, message, wait_for_reply, timeout)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/_drivers/amqpdriver.py", line 405, in _send
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     raise result
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher IndexError: tuple index out of range
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/server.py", line 139, in inner
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     return func(*args, **kwargs)
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 390, in decorated_function
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     args = (_load_instance(args[0]),) + args[1:]
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher IndexError: tuple index out of range
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: console novnc

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1317174

Title:
  novnc console failure after Icehouse upgrade

Status in OpenStack Compute (Nova):
  New

Bug description:
  After upgrading my Havana installation to Icehouse, VNC console logins
  are no longer working (1006 error).

  The version in use is:

  openstack-nova-novncproxy-2014.1-2.el6.noarch

  from RDO.

  This is the full error in the logs:

  2014-05-07 17:12:58.003 13074 AUDIT nova.consoleauth.manager [req-684f9e8d-3c0a-4647-aa66-44f0bb35c4df None None] Checking Token: dbbd1b9b-002f-46b6-bf79-0d90e92c034e, True
  2014-05-07 17:12:58.112 13074 ERROR oslo.messaging.rpc.dispatcher [-] Exception during message handling: tuple index out of range
  Traceback (most recent call last):

    File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
      incoming.message))

    File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
      return self._do_dispatch(endpoint, method, ctxt, args)

    File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
      result = getattr(endpoint, method)(ctxt, **new_args)

    File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/server.py", line 139, in inner
      return func(*args, **kwargs)

    File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 390, in decorated_function
      args = (_load_instance(args[0]),) + args[1:]

  IndexError: tuple index out of range
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/nova/consoleauth/manager.py", line 117, in check_token
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     if self._validate_token(context, token):
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/nova/consoleauth/manager.py", line 108, in _validate_token
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     token['console_type'])
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/nova/compute/rpcapi.py", line 506, in validate_console_port
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     console_type=console_type)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/client.py", line 150, in call
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     wait_for_reply=True, timeout=timeout)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/transport.py", line 90, in _send
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     timeout=timeout)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     return self._send(target, ctxt, message, wait_for_reply, timeout)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/_drivers/amqpdriver.py", line 405, in _send
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     raise result
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher IndexError: tuple index out of range
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/oslo/messaging/rpc/server.py", line 139, in inner
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     return func(*args, **kwargs)
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 390, in decorated_function
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher     args = (_load_instance(args[0]),) + args[1:]
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher IndexError: tuple index out of range
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher 
  2014-05-07 17:12:58.112 13074 TRACE oslo.messaging.rpc.dispatcher

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1317174/+subscriptions
Follow ups

[Bug 1317174] Re: novnc console failure after Icehouse upgrade
From: Thierry Carrez, 2014-10-01
[Bug 1317174] [NEW] novnc console failure after Icehouse upgrade
From: Adam Huffman, 2014-05-07
References

[Bug 1317174] [NEW] novnc console failure after Icehouse upgrade
From: Adam Huffman, 2014-05-07