← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1289036] [NEW] instance will not delete when failing to bind vif's

 

Public bug reported:

This instance will not go away despite multiple 'nova delete's

+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| Property                             | Value                                                                                                                                                                                                  |
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
| OS-DCF:diskConfig                    | MANUAL                                                                                                                                                                                                 |
| OS-EXT-AZ:availability_zone          | nova                                                                                                                                                                                                   |
| OS-EXT-SRV-ATTR:host                 | ci-overcloud-novacompute7-mosbehy6ikhz                                                                                                                                                                 |
| OS-EXT-SRV-ATTR:hypervisor_hostname  | ci-overcloud-novacompute7-mosbehy6ikhz.novalocal                                                                                                                                                       |
| OS-EXT-SRV-ATTR:instance_name        | instance-00003ff9                                                                                                                                                                                      |
| OS-EXT-STS:power_state               | 0                                                                                                                                                                                                      |
| OS-EXT-STS:task_state                | deleting                                                                                                                                                                                               |
| OS-EXT-STS:vm_state                  | error                                                                                                                                                                                                  |
| OS-SRV-USG:launched_at               | -                                                                                                                                                                                                      |
| OS-SRV-USG:terminated_at             | -                                                                                                                                                                                                      |
| accessIPv4                           |                                                                                                                                                                                                        |
| accessIPv6                           |                                                                                                                                                                                                        |
| config_drive                         |                                                                                                                                                                                                        |
| created                              | 2014-03-06T20:57:10Z                                                                                                                                                                                   |
| fault                                | {"message": "Unexpected vif_type=binding_failed", "code": 500, "details": "  File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 253, in decorated_function |
|                                      |     return function(self, context, *args, **kwargs)                                                                                                                                                    |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 2038, in terminate_instance                                                                           |
|                                      |     do_terminate_instance(instance, bdms)                                                                                                                                                              |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/lockutils.py\", line 249, in inner                                                                              |
|                                      |     return f(*args, **kwargs)                                                                                                                                                                          |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 2036, in do_terminate_instance                                                                        |
|                                      |     self._set_instance_error_state(context, instance['uuid'])                                                                                                                                          |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py\", line 68, in __exit__                                                                             |
|                                      |     six.reraise(self.type_, self.value, self.tb)                                                                                                                                                       |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 2026, in do_terminate_instance                                                                        |
|                                      |     reservations=reservations)                                                                                                                                                                         |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/hooks.py\", line 103, in inner                                                                                                   |
|                                      |     rv = f(*args, **kwargs)                                                                                                                                                                            |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 2005, in _delete_instance                                                                             |
|                                      |     user_id=user_id)                                                                                                                                                                                   |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py\", line 68, in __exit__                                                                             |
|                                      |     six.reraise(self.type_, self.value, self.tb)                                                                                                                                                       |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 1975, in _delete_instance                                                                             |
|                                      |     self._shutdown_instance(context, db_inst, bdms)                                                                                                                                                    |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 1908, in _shutdown_instance                                                                           |
|                                      |     requested_networks)                                                                                                                                                                                |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py\", line 68, in __exit__                                                                             |
|                                      |     six.reraise(self.type_, self.value, self.tb)                                                                                                                                                       |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 1898, in _shutdown_instance                                                                           |
|                                      |     block_device_info)                                                                                                                                                                                 |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 931, in destroy                                                                                   |
|                                      |     destroy_disks)                                                                                                                                                                                     |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 967, in cleanup                                                                                   |
|                                      |     self.unplug_vifs(instance, network_info)                                                                                                                                                           |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 838, in unplug_vifs                                                                               |
|                                      |     self.vif_driver.unplug(instance, vif)                                                                                                                                                              |
|                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/libvirt/vif.py\", line 787, in unplug                                                                                       |
|                                      |     _(\"Unexpected vif_type=%s\") % vif_type)                                                                                                                                                          |
|                                      | ", "created": "2014-03-06T22:16:06Z"}                                                                                                                                                                  |
| flavor                               | h1.large (872d8f61-c45a-45c3-87da-466d9f0f241b)                                                                                                                                                        |
| hostId                               | 5f2e908efe96d62cd4c6467e830a62b09c8271860cc67db4db4d6faa                                                                                                                                               |
| id                                   | 7c5aad3e-0cf0-4803-be9f-f428ecbfb261                                                                                                                                                                   |
| image                                | tripleo-precise-1393812840.template.openstack.org (114e4b92-567e-4348-9ed8-e88281104208)                                                                                                               |
| key_name                             | -                                                                                                                                                                                                      |
| metadata                             | {}                                                                                                                                                                                                     |
| name                                 | tripleo-precise-tripleo-test-cloud-2151732.slave.openstack.org                                                                                                                                         |
| os-extended-volumes:volumes_attached | []                                                                                                                                                                                                     |
| status                               | ERROR                                                                                                                                                                                                  |
| tenant_id                            | 64d2d3bc07084ef1accd4e3502909c77                                                                                                                                                                       |
| tripleo-bm-test network              | 192.168.1.146                                                                                                                                                                                          |
| updated                              | 2014-03-06T22:16:03Z                                                                                                                                                                                   |
| user_id                              | 35ef3ce265cb4a25b5303f3daa143f4e                                                                                                                                                                       |
+--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1289036

Title:
  instance will not delete when failing to bind vif's

Status in OpenStack Compute (Nova):
  New

Bug description:
  This instance will not go away despite multiple 'nova delete's

  +--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
  | Property                             | Value                                                                                                                                                                                                  |
  +--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+
  | OS-DCF:diskConfig                    | MANUAL                                                                                                                                                                                                 |
  | OS-EXT-AZ:availability_zone          | nova                                                                                                                                                                                                   |
  | OS-EXT-SRV-ATTR:host                 | ci-overcloud-novacompute7-mosbehy6ikhz                                                                                                                                                                 |
  | OS-EXT-SRV-ATTR:hypervisor_hostname  | ci-overcloud-novacompute7-mosbehy6ikhz.novalocal                                                                                                                                                       |
  | OS-EXT-SRV-ATTR:instance_name        | instance-00003ff9                                                                                                                                                                                      |
  | OS-EXT-STS:power_state               | 0                                                                                                                                                                                                      |
  | OS-EXT-STS:task_state                | deleting                                                                                                                                                                                               |
  | OS-EXT-STS:vm_state                  | error                                                                                                                                                                                                  |
  | OS-SRV-USG:launched_at               | -                                                                                                                                                                                                      |
  | OS-SRV-USG:terminated_at             | -                                                                                                                                                                                                      |
  | accessIPv4                           |                                                                                                                                                                                                        |
  | accessIPv6                           |                                                                                                                                                                                                        |
  | config_drive                         |                                                                                                                                                                                                        |
  | created                              | 2014-03-06T20:57:10Z                                                                                                                                                                                   |
  | fault                                | {"message": "Unexpected vif_type=binding_failed", "code": 500, "details": "  File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 253, in decorated_function |
  |                                      |     return function(self, context, *args, **kwargs)                                                                                                                                                    |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 2038, in terminate_instance                                                                           |
  |                                      |     do_terminate_instance(instance, bdms)                                                                                                                                                              |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/lockutils.py\", line 249, in inner                                                                              |
  |                                      |     return f(*args, **kwargs)                                                                                                                                                                          |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 2036, in do_terminate_instance                                                                        |
  |                                      |     self._set_instance_error_state(context, instance['uuid'])                                                                                                                                          |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py\", line 68, in __exit__                                                                             |
  |                                      |     six.reraise(self.type_, self.value, self.tb)                                                                                                                                                       |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 2026, in do_terminate_instance                                                                        |
  |                                      |     reservations=reservations)                                                                                                                                                                         |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/hooks.py\", line 103, in inner                                                                                                   |
  |                                      |     rv = f(*args, **kwargs)                                                                                                                                                                            |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 2005, in _delete_instance                                                                             |
  |                                      |     user_id=user_id)                                                                                                                                                                                   |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py\", line 68, in __exit__                                                                             |
  |                                      |     six.reraise(self.type_, self.value, self.tb)                                                                                                                                                       |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 1975, in _delete_instance                                                                             |
  |                                      |     self._shutdown_instance(context, db_inst, bdms)                                                                                                                                                    |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 1908, in _shutdown_instance                                                                           |
  |                                      |     requested_networks)                                                                                                                                                                                |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/openstack/common/excutils.py\", line 68, in __exit__                                                                             |
  |                                      |     six.reraise(self.type_, self.value, self.tb)                                                                                                                                                       |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/compute/manager.py\", line 1898, in _shutdown_instance                                                                           |
  |                                      |     block_device_info)                                                                                                                                                                                 |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 931, in destroy                                                                                   |
  |                                      |     destroy_disks)                                                                                                                                                                                     |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 967, in cleanup                                                                                   |
  |                                      |     self.unplug_vifs(instance, network_info)                                                                                                                                                           |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/libvirt/driver.py\", line 838, in unplug_vifs                                                                               |
  |                                      |     self.vif_driver.unplug(instance, vif)                                                                                                                                                              |
  |                                      |   File \"/opt/stack/venvs/nova/local/lib/python2.7/site-packages/nova/virt/libvirt/vif.py\", line 787, in unplug                                                                                       |
  |                                      |     _(\"Unexpected vif_type=%s\") % vif_type)                                                                                                                                                          |
  |                                      | ", "created": "2014-03-06T22:16:06Z"}                                                                                                                                                                  |
  | flavor                               | h1.large (872d8f61-c45a-45c3-87da-466d9f0f241b)                                                                                                                                                        |
  | hostId                               | 5f2e908efe96d62cd4c6467e830a62b09c8271860cc67db4db4d6faa                                                                                                                                               |
  | id                                   | 7c5aad3e-0cf0-4803-be9f-f428ecbfb261                                                                                                                                                                   |
  | image                                | tripleo-precise-1393812840.template.openstack.org (114e4b92-567e-4348-9ed8-e88281104208)                                                                                                               |
  | key_name                             | -                                                                                                                                                                                                      |
  | metadata                             | {}                                                                                                                                                                                                     |
  | name                                 | tripleo-precise-tripleo-test-cloud-2151732.slave.openstack.org                                                                                                                                         |
  | os-extended-volumes:volumes_attached | []                                                                                                                                                                                                     |
  | status                               | ERROR                                                                                                                                                                                                  |
  | tenant_id                            | 64d2d3bc07084ef1accd4e3502909c77                                                                                                                                                                       |
  | tripleo-bm-test network              | 192.168.1.146                                                                                                                                                                                          |
  | updated                              | 2014-03-06T22:16:03Z                                                                                                                                                                                   |
  | user_id                              | 35ef3ce265cb4a25b5303f3daa143f4e                                                                                                                                                                       |
  +--------------------------------------+--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------+

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1289036/+subscriptions


Follow ups

References