← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1968555] [NEW] evacuate after network issue will cause vm running on two host

 

Public bug reported:

Environment
===========
openstack queen + libvirt 4.5.0 + qemu 2.12 running on centos7, with ceph rbd storage

Description
===========
If the management network of the compute host is abnormal, it may cause nova-compute down but the openstack-nova-compute.service is still running on that host. Now you evacuate a vm on that host, the evacuate will succeed, the vm will be running both on the old host and the new host even after the management network of old host recover, it may cause vm error.   

Steps to reproduce
==================
1. Manually turn down the management network port of the compute host, like ifconfig eth0 down
2. After the nova-compute of that host see down with openstack compute service list, evacuate one vm on that host:
nova evacuate <vm's uuid>
3. After evacuate succeed, you can find the vm running on two host.
4. Manually turn up the management network port of the old compute host, like ifconfig eth0 up, you can find the vm still running on this host, it can't be auto destroy unless you restart the openstack-nova-compute.service on that host.

Expected result
===============
Maybe we can add a periodic task to auto destroy this vm?

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1968555

Title:
  evacuate after network issue will cause vm running on two host

Status in OpenStack Compute (nova):
  New

Bug description:
  Environment
  ===========
  openstack queen + libvirt 4.5.0 + qemu 2.12 running on centos7, with ceph rbd storage

  Description
  ===========
  If the management network of the compute host is abnormal, it may cause nova-compute down but the openstack-nova-compute.service is still running on that host. Now you evacuate a vm on that host, the evacuate will succeed, the vm will be running both on the old host and the new host even after the management network of old host recover, it may cause vm error.   

  Steps to reproduce
  ==================
  1. Manually turn down the management network port of the compute host, like ifconfig eth0 down
  2. After the nova-compute of that host see down with openstack compute service list, evacuate one vm on that host:
  nova evacuate <vm's uuid>
  3. After evacuate succeed, you can find the vm running on two host.
  4. Manually turn up the management network port of the old compute host, like ifconfig eth0 up, you can find the vm still running on this host, it can't be auto destroy unless you restart the openstack-nova-compute.service on that host.

  Expected result
  ===============
  Maybe we can add a periodic task to auto destroy this vm?

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1968555/+subscriptions



Follow ups