yahoo-eng-team team mailing list archive

[Tushar Patil <1368844@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

Tested on master code with commit id :
fd72c308fc6adc1f5d07c5287c1db5bfc12328fc

volume_driver = cinder.volume.drivers.lvm.LVMISCSIDriver

Case 1: Instance is booted using volume
 
Steps to reproduce:
1. Create a bootable volume of size 2 GB using an image.
2. Boot an instance with this volume on host 1.
3. Block migrate the instance on host 2
4. Instance will not be migrated and migration fails with below mentioned error log message on the source compute node
 
Case 2: Instance is booted using image then attach a volume to this newly booted instance
 
Steps to reproduce:
1. Create a volume of size 2 GB.
2. Boot an instance using image on host 1.
3. Attach a 2 GB volume to this instance.
3. Block migrate the instance on host 2.
4. Instance will not be migrated and migration fails with below mentioned error log message on the source compute node
 

Error Log message on the source compute node:
{{{
2014-09-11 02:42:41.884 ERROR nova.virt.libvirt.driver [-] [instance: ca59bee5-bae5-4c61-9e01-f76a1df3d324]
Live Migration failure: operation failed: migration job: unexpectedly failed
Traceback (most recent call last):
  File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/poll.py", line 115, in wait
    listener.cb(fileno)
  File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 212, in main
    result = function(*args, **kwargs)
  File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5128, in _live_migration
    recover_method(context, instance, dest, block_migration)
  File "/opt/stack/nova/nova/openstack/common/excutils.py", line 82, in __exit__
    six.reraise(self.type_, self.value, self.tb)
  File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5122, in _live_migration
    CONF.libvirt.live_migration_bandwidth)
  File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 183, in doit
    result = proxy_call(self._autowrap, f, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 141, in proxy_call
    rv = execute(f, *args, **kwargs)
  File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 122, in execute
    six.reraise(c, e, tb)
  File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 80, in tworker
    rv = meth(*args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1582, in migrateToURI2
    if ret == -1: raise libvirtError ('virDomainMigrateToURI2() failed', dom=self)
libvirtError: operation failed: migration job: unexpectedly failed
Removing descriptor: 19
}}}

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1368844

Title:
  Block migration fails with volume size 2 GB and more

Status in OpenStack Compute (Nova):
  New

Bug description:
  Tested on master code with commit id :
  fd72c308fc6adc1f5d07c5287c1db5bfc12328fc

  volume_driver = cinder.volume.drivers.lvm.LVMISCSIDriver

  Case 1: Instance is booted using volume
   
  Steps to reproduce:
  1. Create a bootable volume of size 2 GB using an image.
  2. Boot an instance with this volume on host 1.
  3. Block migrate the instance on host 2
  4. Instance will not be migrated and migration fails with below mentioned error log message on the source compute node
   
  Case 2: Instance is booted using image then attach a volume to this newly booted instance
   
  Steps to reproduce:
  1. Create a volume of size 2 GB.
  2. Boot an instance using image on host 1.
  3. Attach a 2 GB volume to this instance.
  3. Block migrate the instance on host 2.
  4. Instance will not be migrated and migration fails with below mentioned error log message on the source compute node
   

  Error Log message on the source compute node:
  {{{
  2014-09-11 02:42:41.884 ERROR nova.virt.libvirt.driver [-] [instance: ca59bee5-bae5-4c61-9e01-f76a1df3d324]
  Live Migration failure: operation failed: migration job: unexpectedly failed
  Traceback (most recent call last):
    File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/poll.py", line 115, in wait
      listener.cb(fileno)
    File "/usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py", line 212, in main
      result = function(*args, **kwargs)
    File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5128, in _live_migration
      recover_method(context, instance, dest, block_migration)
    File "/opt/stack/nova/nova/openstack/common/excutils.py", line 82, in __exit__
      six.reraise(self.type_, self.value, self.tb)
    File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 5122, in _live_migration
      CONF.libvirt.live_migration_bandwidth)
    File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 183, in doit
      result = proxy_call(self._autowrap, f, *args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 141, in proxy_call
      rv = execute(f, *args, **kwargs)
    File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 122, in execute
      six.reraise(c, e, tb)
    File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 80, in tworker
      rv = meth(*args, **kwargs)
    File "/usr/lib/python2.7/dist-packages/libvirt.py", line 1582, in migrateToURI2
      if ret == -1: raise libvirtError ('virDomainMigrateToURI2() failed', dom=self)
  libvirtError: operation failed: migration job: unexpectedly failed
  Removing descriptor: 19
  }}}

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1368844/+subscriptions