yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1257532] [NEW] Shelving fails with KeyError: 'metadata'

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Sam Morrison <1257532@xxxxxxxxxxxxxxxxxx>
Date: Tue, 03 Dec 2013 23:43:29 -0000
Reply-to: Bug 1257532 <1257532@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

When I try and shelve an instance I get the following error on the
compute node:

2013-12-04 10:39:59.716 18800 ERROR nova.openstack.common.rpc.amqp [req-d87825e7-9c2f-4735-94e2-4c470ee0edab d9646718471b46aeb5fd94c702336ca9 0bdf024c921848c4b74d9e69af9edf08] Exception during message handling
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     **args)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 90, in wrapped
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     payload)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 73, in wrapped
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 243, in decorated_function
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     pass
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 229, in decorated_function
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 294, in decorated_function
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 271, in decorated_function
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 258, in decorated_function
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3336, in shelve_instance
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     current_period=True)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 292, in notify_usage_exists
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     system_metadata, extra_usage_info)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 1094, in wrapper
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     return func(*args, **kwargs)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 486, in notify_usage_exists
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     system_metadata, extra_usage_info)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 295, in notify_usage_exists
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     system_metadata=system_metadata, extra_usage_info=extra_info)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 316, in notify_about_instance_usage
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     network_info, system_metadata, **extra_usage_info)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/notifications.py", line 420, in info_from_instance
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     instance_info['metadata'] = utils.instance_meta(instance_ref)
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 1044, in instance_meta
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     if isinstance(instance['metadata'], dict):
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp KeyError: 'metadata'
2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1257532

Title:
  Shelving fails with KeyError: 'metadata'

Status in OpenStack Compute (Nova):
  New

Bug description:
  When I try and shelve an instance I get the following error on the
  compute node:

  2013-12-04 10:39:59.716 18800 ERROR nova.openstack.common.rpc.amqp [req-d87825e7-9c2f-4735-94e2-4c470ee0edab d9646718471b46aeb5fd94c702336ca9 0bdf024c921848c4b74d9e69af9edf08] Exception during message handling
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     **args)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 90, in wrapped
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     payload)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 73, in wrapped
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 243, in decorated_function
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     pass
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 229, in decorated_function
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 294, in decorated_function
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 271, in decorated_function
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 258, in decorated_function
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3336, in shelve_instance
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     current_period=True)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/conductor/api.py", line 292, in notify_usage_exists
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     system_metadata, extra_usage_info)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 1094, in wrapper
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     return func(*args, **kwargs)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 486, in notify_usage_exists
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     system_metadata, extra_usage_info)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 295, in notify_usage_exists
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     system_metadata=system_metadata, extra_usage_info=extra_info)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/utils.py", line 316, in notify_about_instance_usage
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     network_info, system_metadata, **extra_usage_info)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/notifications.py", line 420, in info_from_instance
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     instance_info['metadata'] = utils.instance_meta(instance_ref)
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 1044, in instance_meta
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp     if isinstance(instance['metadata'], dict):
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp KeyError: 'metadata'
  2013-12-04 10:39:59.716 18800 TRACE nova.openstack.common.rpc.amqp

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1257532/+subscriptions
Follow ups

[Bug 1257532] Re: Shelving fails with KeyError: 'metadata'
From: Dan Smith, 2014-03-14
[Bug 1257532] [NEW] Shelving fails with KeyError: 'metadata'
From: Sam Morrison, 2013-12-03
References

[Bug 1257532] [NEW] Shelving fails with KeyError: 'metadata'
From: Sam Morrison, 2013-12-03