← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1068048] Re: nova live-migration with ceph backend attempts to detach vda

 

I have met the same error.

and I try directly run libvirt command :
virsh migrate --live instance-00000782 qemu+ssh://root@compute-node-2/system --verbose

It works fine.

** Changed in: nova
       Status: Invalid => Confirmed

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1068048

Title:
  nova live-migration with ceph backend attempts to detach vda

Status in OpenStack Compute (Nova):
  Confirmed

Bug description:
  Migration of an instance between two Folsom Compute nodes more often
  than not results in failure.

  When attempting to migrate a VM with
  block_device_mapping=vda:ceph_volume destination compute node attempts
  to detach vda

  Destination host on failed migration: http://pastebin.com/3GRnZzkL
  Source host on failed migration: http://pastebin.com/dMann0vL

  About 4 attempts later, after no changes.
  Destination host on successful migration: http://pastebin.com/aSDN4Myn
  Source host on successful migration: http://pastebin.com/PW1LbeW8

  
  Command being run:
  [admin:admin] root@openstack-control:~# nova live-migration 8c5cde28-904c-49ee-ac18-2885e87925b7 openstack-compute1

  
  Info:
  [demo:demo] root@openstack-control:~# nova boot --flavor 1 --image 7c55a705-c642-4223-914a-44e777beb859 --key_name mykey --block_device_mapping vda=923f330d-a084-491d-a32b-b4e38ccc9ca1::10:0 l-vol-vm_1
  [demo:demo] root@openstack-control:~# nova boot --flavor 1 --image 7c55a705-c642-4223-914a-44e777beb859 --key_name mykey --block_device_mapping vda=bb9a9ae7-e3c6-43f6-9aae-2701e1543adc::10:0 l-vol-vm_2
  [demo:demo] root@openstack-control:~# nova boot --flavor 1 --image 7c55a705-c642-4223-914a-44e777beb859 --key_name mykey --block_device_mapping vda=74dcc66f-53fc-43ec-9f79-16e8442d4b5c::10:0 l-vol-vm_3

  [demo:demo] root@openstack-control:~# nova list
  +--------------------------------------+------------+-----------+-------------------+
  | ID                                   | Name       | Status    | Networks          |
  +--------------------------------------+------------+-----------+-------------------+
  | 050c406b-3a3b-41b3-85ae-7ab4765f8d6e | l-vol-vm_1 | ACTIVE    | demo-net=10.7.7.7 |
  | 8c5cde28-904c-49ee-ac18-2885e87925b7 | l-vol-vm_2 | ACTIVE    | demo-net=10.7.7.8 |
  | 1fb5935f-8ab0-4464-8eb7-35b355f3c2ad | l-vol-vm_3 | ACTIVE    | demo-net=10.7.7.3 |
  +--------------------------------------+------------+-----------+-------------------+

  [demo:demo] root@openstack-control:~# cinder list
  +--------------------------------------+-----------+------------------+------+-------------+--------------------------------------+
  |                  ID                  |   Status  |   Display Name   | Size | Volume Type |             Attached to              |
  +--------------------------------------+-----------+------------------+------+-------------+--------------------------------------+
  | 74dcc66f-53fc-43ec-9f79-16e8442d4b5c |   in-use  |  linux-vm_3-vol  |  10  |     None    | 1fb5935f-8ab0-4464-8eb7-35b355f3c2ad |
  | 923f330d-a084-491d-a32b-b4e38ccc9ca1 |   in-use  |  linux-vm_1-vol  |  10  |     None    | 050c406b-3a3b-41b3-85ae-7ab4765f8d6e |
  | bb9a9ae7-e3c6-43f6-9aae-2701e1543adc |   in-use  |  linux-vm_2-vol  |  10  |     None    | 8c5cde28-904c-49ee-ac18-2885e87925b7 |
  | ccb71b41-efdf-4ae3-8b3e-ccb299a378e5 | available | Linux-Master-Vol |  10  |     None    |                                      |
  +--------------------------------------+-----------+------------------+------+-------------+--------------------------------------+

  
  Compute nodes are both running:
  ceph-common 0.53-1precise
  libvirt-bin 0.9.8-2ubuntu17.4
  libvirt0 0.9.8-2ubuntu17.4
  nova-common 2012.2+git201210091907~precise-0ubuntu1
  nova-compute 2012.2+git201210091907~precise-0ubuntu1
  nova-compute-kvm 2012.2+git201210091907~precise-0ubuntu1
  openvswitch-common 1.4.0-1ubuntu1.3
  openvswitch-datapath-dkms 1.4.0-1ubuntu1.3
  openvswitch-switch 1.4.0-1ubuntu1.3
  python-libvirt 0.9.8-2ubuntu17.4
  python-nova 2012.2+git201210091907~precise-0ubuntu1
  python-novaclient 1:2.9.0.10+git201210101300~precise-0ubuntu1
  python-quantum 2012.2+git201209271425~precise-0ubuntu1
  python-quantumclient 1:2.1.1+git201209200900~precise-0ubuntu1
  quantum-common 2012.2+git201209271425~precise-0ubuntu1
  quantum-plugin-openvswitch 2012.2+git201209271425~precise-0ubuntu1
  quantum-plugin-openvswitch-agent 2012.2+git201209271425~precise-0ubuntu1

  Control node is running:
  ceph-common 0.53-1precise
  cinder-api 2012.2+git201209252100~precise-0ubuntu1
  cinder-common 2012.2+git201209252100~precise-0ubuntu1
  cinder-scheduler 2012.2+git201209252100~precise-0ubuntu1
  cinder-volume 2012.2+git201209252100~precise-0ubuntu1
  glance 2012.2+git201209250330~precise-0ubuntu1
  glance-api 2012.2+git201209250330~precise-0ubuntu1
  glance-common 2012.2+git201209250330~precise-0ubuntu1
  glance-registry 2012.2+git201209250330~precise-0ubuntu1
  keystone 2012.2+git201209252030~precise-0ubuntu1
  nova-api 2012.2+git201210091907~precise-0ubuntu1
  nova-cert 2012.2+git201210091907~precise-0ubuntu1
  nova-common 2012.2+git201210091907~precise-0ubuntu1
  nova-consoleauth 2012.2+git201210091907~precise-0ubuntu1
  nova-novncproxy 2012.2+git201210091907~precise-0ubuntu1
  nova-scheduler 2012.2+git201210091907~precise-0ubuntu1
  openvswitch-common 1.4.0-1ubuntu1.3
  openvswitch-datapath-dkms 1.4.0-1ubuntu1.3
  openvswitch-datapath-module-3.2.0-32-generic 1.4.0-1ubuntu1.3
  openvswitch-datapath-source 1.4.0-1ubuntu1.3
  openvswitch-switch 1.4.0-1ubuntu1.3
  postgresql-9.1 9.1.6-0ubuntu12.04
  postgresql-client-9.1 9.1.6-0ubuntu12.04
  postgresql-client-common 129ubuntu1
  postgresql-common 129ubuntu1
  python-cinder 2012.2+git201209252100~precise-0ubuntu1
  python-cinderclient 1:1.0.0.1+git201210051400~precise-0ubuntu1
  python-glance 2012.2+git201209250330~precise-0ubuntu1
  python-glanceclient 1:0.5.1.8.cdc06d9+git201210051430~precise-0ubuntu1
  python-keystone 2012.2+git201209252030~precise-0ubuntu1
  python-keystoneclient 1:0.1.3.27+git201210122030~precise-0ubuntu1
  python-nova 2012.2+git201210091907~precise-0ubuntu1
  python-novaclient 1:2.9.0.10+git201210101300~precise-0ubuntu1
  quantum-plugin-openvswitch 2012.2+git201209271425~precise-0ubuntu1
  quantum-plugin-openvswitch-agent 2012.2+git201209271425~precise-0ubuntu1
  rabbitmq-server 2.7.1-0ubuntu4

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1068048/+subscriptions