← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1397794] [NEW] Delete instance failed, the task_state stay on deleting and can not revert to none, because the InvalidBDMVolume exception is not handled.

 

Public bug reported:

1. Delete instance failed, the task_state stay on deleting  and can not
revert to none.

[root@opencos_114_222 ~(keystone_admin)]# nova list
+--------------------------------------+------+--------+------------+-------------+------------------+
| ID                                   | Name | Status | Task State | Power State | Networks         |
+--------------------------------------+------+--------+------------+-------------+------------------+
| bc177a3d-edf8-4d24-b991-f945a2a44389 | 1    | ERROR  | deleting   | Running     | net1=192.168.0.3 |
+--------------------------------------+------+--------+------------+-------------+------------------+

2. The log is as follows:
2014-12-01 18:43:26.319 3817 INFO nova.compute.manager [-] [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Service started deleting the instance during the previous run, but did not finish. Restarting the deletion now.
2014-12-01 18:43:26.596 3817 AUDIT nova.compute.manager [req-dc183820-078a-4098-a7a2-50bbd598e90d None None] [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Terminating instance
2014-12-01 18:43:26.619 3817 INFO nova.virt.libvirt.driver [-] [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Instance destroyed successfully.
2014-12-01 18:43:27.773 3817 ERROR nova.compute.manager [-] [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Failed to complete a deletion
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Traceback (most recent call last):
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 886, in _init_instance
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     self._delete_instance(context, instance, bdms, quotas)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 103, in inner
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     rv = f(*args, **kwargs)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2312, in _delete_instance
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     quotas.rollback()
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     six.reraise(self.type_, self.value, self.tb)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2284, in _delete_instance
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     self._shutdown_instance(context, db_inst, bdms)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2222, in _shutdown_instance
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     requested_networks)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     six.reraise(self.type_, self.value, self.tb)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2212, in _shutdown_instance
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     block_device_info)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 967, in destroy
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     destroy_disks)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1046, in cleanup
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     volume_meta['properties'] = self._get_volume_metadata(context, connection_info)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3082, in _get_volume_metadata
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     raise exception.InvalidBDMVolume(id=volume_id)
2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] InvalidBDMVolume: Block Device Mapping is Invalid: failed to get volume 0facade0-26d8-4aa8-9367-01f11f8a761b.

3. The exception of InvalidBDMVolume is not handled when it is raised.

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: in-stable-icehouse

** Tags added: in-stable-icehouse

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1397794

Title:
  Delete instance failed, the task_state stay on deleting  and can not
  revert to none,  because the InvalidBDMVolume exception is not
  handled.

Status in OpenStack Compute (Nova):
  New

Bug description:
  1. Delete instance failed, the task_state stay on deleting  and can
  not revert to none.

  [root@opencos_114_222 ~(keystone_admin)]# nova list
  +--------------------------------------+------+--------+------------+-------------+------------------+
  | ID                                   | Name | Status | Task State | Power State | Networks         |
  +--------------------------------------+------+--------+------------+-------------+------------------+
  | bc177a3d-edf8-4d24-b991-f945a2a44389 | 1    | ERROR  | deleting   | Running     | net1=192.168.0.3 |
  +--------------------------------------+------+--------+------------+-------------+------------------+

  2. The log is as follows:
  2014-12-01 18:43:26.319 3817 INFO nova.compute.manager [-] [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Service started deleting the instance during the previous run, but did not finish. Restarting the deletion now.
  2014-12-01 18:43:26.596 3817 AUDIT nova.compute.manager [req-dc183820-078a-4098-a7a2-50bbd598e90d None None] [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Terminating instance
  2014-12-01 18:43:26.619 3817 INFO nova.virt.libvirt.driver [-] [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Instance destroyed successfully.
  2014-12-01 18:43:27.773 3817 ERROR nova.compute.manager [-] [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Failed to complete a deletion
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] Traceback (most recent call last):
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 886, in _init_instance
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     self._delete_instance(context, instance, bdms, quotas)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/hooks.py", line 103, in inner
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     rv = f(*args, **kwargs)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2312, in _delete_instance
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     quotas.rollback()
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     six.reraise(self.type_, self.value, self.tb)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2284, in _delete_instance
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     self._shutdown_instance(context, db_inst, bdms)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2222, in _shutdown_instance
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     requested_networks)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     six.reraise(self.type_, self.value, self.tb)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2212, in _shutdown_instance
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     block_device_info)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 967, in destroy
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     destroy_disks)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 1046, in cleanup
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     volume_meta['properties'] = self._get_volume_metadata(context, connection_info)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3082, in _get_volume_metadata
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389]     raise exception.InvalidBDMVolume(id=volume_id)
  2014-12-01 18:43:27.773 3817 TRACE nova.compute.manager [instance: bc177a3d-edf8-4d24-b991-f945a2a44389] InvalidBDMVolume: Block Device Mapping is Invalid: failed to get volume 0facade0-26d8-4aa8-9367-01f11f8a761b.

  3. The exception of InvalidBDMVolume is not handled when it is raised.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1397794/+subscriptions


Follow ups

References