yahoo-eng-team team mailing list archive

[Thierry Carrez <thierry.carrez+lp@xxxxxxxxx>]

** Changed in: nova
       Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1423952

Title:
  It is impossible to delete an instance that has failed due to
  neutron/nova notification problems

Status in OpenStack Compute (Nova):
  Fix Released
Status in OpenStack Compute (nova) icehouse series:
  Fix Released
Status in OpenStack Compute (nova) juno series:
  Fix Committed

Bug description:
  If you attempt to boot a nova instance without Neutron properly
  configured for neutron/nova notifications, the instance will
  eventually fail to spawn:

    [-] [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd] Instance failed to spawn
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd] Traceback (most recent call last):
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2243, in _build_resources
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd]     yield resources
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2113, in _build_and_run_instance
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd]     block_device_info=block_device_info)
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2622, in spawn
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd]     block_device_info, disk_info=disk_info)
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4439, in _create_domain_and_network
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd]     raise exception.VirtualInterfaceCreateException()
    [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd] VirtualInterfaceCreateException: Virtual Interface creation failed

  If you try to delete this instance, the delete operation will fail. In
  the logs, you see:

    AUDIT nova.compute.manager [req-a4b30d0b-e6d3-429f-8f7a-b7788b79c86c None] [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd] Terminating instance
    WARNING nova.virt.libvirt.driver [-] [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd] During wait destroy, instance disappeared.
    INFO nova.virt.libvirt.driver [req-a4b30d0b-e6d3-429f-8f7a-b7788b79c86c None] [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd] Deletion of /var/lib/nova/instances/1541a197-9f80-4ee5-a7d6-08e591aa83fd_del complete
    INFO nova.compute.manager [req-a4b30d0b-e6d3-429f-8f7a-b7788b79c86c None] [instance: 1541a197-9f80-4ee5-a7d6-08e591aa83fd] Instance disappeared during terminate

  At this point, `nova list` will show:

    | 1541a197-9f80-4ee5-a7d6-08e591aa83fd | test0    | ERROR   |
  deleting   | NOSTATE     |                                  |

  And it appears to be impossible to delete this instance.  Running
  "nova reset-state <instance>"  has no effect (with or without
  --active), nor does correctly configuring neutron.

  The only way to get rid of this instance appears to be directly
  editing the database.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1423952/+subscriptions