← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1166927] Re: Migrating multiple instances causes 'u'\'NoneType\' object is unsubscriptable ' Error

 

** Changed in: nova
       Status: Incomplete => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1166927

Title:
  Migrating multiple instances causes 'u'\'NoneType\' object is
  unsubscriptable ' Error

Status in OpenStack Compute (Nova):
  Invalid

Bug description:
  * When I do a resize-confirm on instances that have been migrated I
  get a unsubscriptable error.

  (1).  Boot multiple instances

  nova boot --image 9792609f-7b42-424b-9826-ae31c426f0bd --flavor 1 MIGRATE1
  nova boot --image 9792609f-7b42-424b-9826-ae31c426f0bd --flavor 1 MIGRATE2
  nova boot --image 9792609f-7b42-424b-9826-ae31c426f0bd --flavor 1 MIGRATE3

  MIGRATE1:::vs33x-instance-00000053:::olyblade02
  MIGRATE2:::vs33x-instance-00000054:::olyblade02
  MIGRATE3:::vs33x-instance-00000055:::olyblade02

  [root@vs339 ~]# nova list
  +--------------------------------------+----------+--------+-------------------+
  | ID                                   | Name     | Status | Networks          |
  +--------------------------------------+----------+--------+-------------------+
  | 01761a76-1fe9-40ae-9f31-ebd019c7c8c6 | MIGRATE1 | ACTIVE | network1=10.0.1.4 |
  | 3dfe852f-e0e5-4511-a16d-3ff7b3f278a2 | MIGRATE2 | ACTIVE | network1=10.0.1.3 |
  | d800eab4-f91e-48f9-b208-e5821f4da6b1 | MIGRATE3 | ACTIVE | network1=10.0.1.6 |
  +--------------------------------------+----------+--------+-------------------+

  (2).  Migrate the instances

  * They all came back to verify_resize state:

  +--------------------------------------+----------+---------------+-------------------+
  | ID                                   | Name     | Status        | Networks          |
  +--------------------------------------+----------+---------------+-------------------+
  | 01761a76-1fe9-40ae-9f31-ebd019c7c8c6 | MIGRATE1 | VERIFY_RESIZE | network1=10.0.1.4 |
  | 3dfe852f-e0e5-4511-a16d-3ff7b3f278a2 | MIGRATE2 | VERIFY_RESIZE | network1=10.0.1.3 |
  | d800eab4-f91e-48f9-b208-e5821f4da6b1 | MIGRATE3 | VERIFY_RESIZE | network1=10.0.1.6 |
  +--------------------------------------+----------+---------------+-------------------+

  (3).  Resize-confirm

  * Attempt a resize-confirm on the instances

  - My instance went to ERROR
  [root@vs339 ~]# nova list
  +--------------------------------------+----------+--------+-------------------+
  | ID                                   | Name     | Status | Networks          |
  +--------------------------------------+----------+--------+-------------------+
  | 01761a76-1fe9-40ae-9f31-ebd019c7c8c6 | MIGRATE1 | ERROR  | network1=10.0.1.4 |
  | 3dfe852f-e0e5-4511-a16d-3ff7b3f278a2 | MIGRATE2 | ACTIVE | network1=10.0.1.3 |
  | d800eab4-f91e-48f9-b208-e5821f4da6b1 | MIGRATE3 | ACTIVE | network1=10.0.1.6 |
  +--------------------------------------+----------+--------+-------------------+

  [root@vs339 ~]# nova show MIGRATE1
  +-------------------------------------+------------------------------------------------------------------------------------------------------------------------+
  | Property                            | Value                                                                                                                  |
  +-------------------------------------+------------------------------------------------------------------------------------------------------------------------+
  | status                              | ERROR                                                                                                                  |
  | updated                             | 2013-04-09T16:20:47Z                                                                                                   |
  | OS-EXT-STS:task_state               | None                                                                                                                   |
  | OS-EXT-SRV-ATTR:host                | vs339.rch.kstart.ibm.com                                                                                               |
  | key_name                            | None                                                                                                                   |
  | image                               | Rhel6MasterFile (9792609f-7b42-424b-9826-ae31c426f0bd)                                                                 |
  | network1 network                    | 10.0.1.4                                                                                                               |
  | hostId                              | d9d08dd10c89d762c75d081740e855c61bf3bf5c1083e4b73738dfdb                                                               |
  | OS-EXT-STS:vm_state                 | error                                                                                                                  |
  | OS-EXT-SRV-ATTR:instance_name       | vs33x-instance-00000053                                                                                                |
  | OS-EXT-SRV-ATTR:hypervisor_hostname | olyblade01.rch.stglabs.ibm.com                                                                                         |
  | flavor                              | m1.tiny (1)                                                                                                            |
  | id                                  | 01761a76-1fe9-40ae-9f31-ebd019c7c8c6                                                                                   |
  | security_groups                     | [{u'name': u'default'}]                                                                                                |
  | user_id                             | 63233eadd9b1471c98b113d1b0af6c29                                                                                       |
  | name                                | MIGRATE1                                                                                                               |
  | created                             | 2013-04-09T15:37:45Z                                                                                                   |
  | tenant_id                           | b95d5e33d9b84a8e96787bcf6d91fc5c                                                                                       |
  | OS-DCF:diskConfig                   | MANUAL                                                                                                                 |
  | metadata                            | {}                                                                                                                     |
  | accessIPv4                          |                                                                                                                        |
  | accessIPv6                          |                                                                                                                        |
  | fault                               | {u'message': u'TypeError', u'code': 500, u'details': u'\'NoneType\' object is unsubscriptable                          |
  |                                     |   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 230, in decorated_function                     |
  |                                     |     return function(self, context, *args, **kwargs)                                                                    |
  |                                     |   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 2048, in confirm_resize                        |
  |                                     |     rt.confirm_resize(context, migration)                                                                              |
  |                                     |   File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 373, in confirm_resize                |
  |                                     |     self.update_available_resource(elevated)                                                                           |
  |                                     |   File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 242, in inner                       |
  |                                     |     retval = f(*args, **kwargs)                                                                                        |
  |                                     |   File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 269, in update_available_resource     |
  |                                     |     self._update_usage_from_migrations(resources, migrations)                                                          |
  |                                     |   File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 466, in _update_usage_from_migrations |
  |                                     |     migration)                                                                                                         |
  |                                     |   File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 426, in _update_usage_from_migration  |
  |                                     |     itype = instance_types.extract_instance_type(instance, \'old_\')                                                   |
  |                                     |   File "/usr/lib/python2.6/site-packages/nova/compute/instance_types.py", line 247, in extract_instance_type           |
  |                                     |     sys_meta = utils.metadata_to_dict(instance[\'system_metadata\'])                                                   |
  |                                     | ', u'created': u'2013-04-09T16:21:07Z'}                                                                                |
  | OS-EXT-STS:power_state              | 1                                                                                                                      |
  | OS-EXT-AZ:availability_zone         | nova                                                                                                                   |
  | config_drive                        |                                                                                                                        |
  +-------------------------------------+------------------------------------------------------------------------------------------------------------------------+

  
  - I hit the unsubscritable error:

  2013-04-09 11:18:20.971 1192 ERROR nova.manager [-] Error during ComputeManager.update_available_resource: 'NoneType' object is unsubscriptable
  2013-04-09 11:18:20.971 1192 TRACE nova.manager Traceback (most recent call last):
  2013-04-09 11:18:20.971 1192 TRACE nova.manager   File "/usr/lib/python2.6/site-packages/nova/manager.py", line 244, in periodic_tasks
  2013-04-09 11:18:20.971 1192 TRACE nova.manager     task(self, context)
  2013-04-09 11:18:20.971 1192 TRACE nova.manager   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 3862, in update_available_resource
  2013-04-09 11:18:20.971 1192 TRACE nova.manager     rt.update_available_resource(context)
  2013-04-09 11:18:20.971 1192 TRACE nova.manager   File "/usr/lib/python2.6/site-packages/nova/openstack/common/lockutils.py", line 242, in inner
  2013-04-09 11:18:20.971 1192 TRACE nova.manager     retval = f(*args, **kwargs)
  2013-04-09 11:18:20.971 1192 TRACE nova.manager   File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 269, in update_available_resource
  2013-04-09 11:18:20.971 1192 TRACE nova.manager     self._update_usage_from_migrations(resources, migrations)
  2013-04-09 11:18:20.971 1192 TRACE nova.manager   File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 466, in _update_usage_from_migrations
  2013-04-09 11:18:20.971 1192 TRACE nova.manager     migration)
  2013-04-09 11:18:20.971 1192 TRACE nova.manager   File "/usr/lib/python2.6/site-packages/nova/compute/resource_tracker.py", line 426, in _update_usage_from_migration
  2013-04-09 11:18:20.971 1192 TRACE nova.manager     itype = instance_types.extract_instance_type(instance, 'old_')
  2013-04-09 11:18:20.971 1192 TRACE nova.manager   File "/usr/lib/python2.6/site-packages/nova/compute/instance_types.py", line 247, in extract_instance_type
  2013-04-09 11:18:20.971 1192 TRACE nova.manager     sys_meta = utils.metadata_to_dict(instance['system_metadata'])
  2013-04-09 11:18:20.971 1192 TRACE nova.manager TypeError: 'NoneType' object is unsubscriptable
  2013-04-09 11:18:20.971 1192 TRACE nova.manager

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1166927/+subscriptions