yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1262601] [NEW] Can't do "resize" on shared storage

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Martins Jakubovics <martins@xxxxxxxxxx>
Date: Thu, 19 Dec 2013 10:48:28 -0000
Reply-to: Bug 1262601 <1262601@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Can't do "resize" to instance (at least to bigger flavor) on shared storage using XenServer as hypervisor.
Additionaly, if fails to "resize", VM is crashed too, I don't get a way to restore it in OpenStack. In XenServer VM is running, but by different name:

Before - instance-00000031
After - instance-00000031-orig

2013-12-19 12:41:20.549 7888 ERROR nova.compute.manager [req-618c5498-3a38-4a34-a763-07e2c0c2cdeb 9ffbc08b941540c69a804ecfa4d3dc4e 76619aca43f841e0bed1a3b89ce8b426] [instance: e6903021-bdee-4f59-ad31-6cc686851eaa] Setting instance vm_state to ERROR
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa] Traceback (most recent call last):
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4967, in _error_out_instance_on_exception
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     yield
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3021, in resize_instance
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     block_device_info)
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/driver.py", line 284, in migrate_disk_and_power_off
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     dest, instance_type, block_device_info)
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 939, in migrate_disk_and_power_off
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     context, instance, dest, vm_ref, sr_path)
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 882, in _migrate_disk_resizing_up
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     self._migrate_vhd(instance, vdi_uuid, dest, sr_path, seq_num)
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 770, in _migrate_vhd
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     raise exception.MigrationError(reason=msg)
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa] MigrationError: Migration error: Failed to transfer vhd to new host
2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]
2013-12-19 12:41:20.956 7888 ERROR nova.openstack.common.rpc.amqp [req-618c5498-3a38-4a34-a763-07e2c0c2cdeb 9ffbc08b941540c69a804ecfa4d3dc4e 76619aca43f841e0bed1a3b89ce8b426] Exception during message handling
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     **args)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 353, in decorated_function
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 90, in wrapped
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     payload)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 73, in wrapped
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 243, in decorated_function
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     pass
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 229, in decorated_function
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 294, in decorated_function
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 271, in decorated_function
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 258, in decorated_function
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3021, in resize_instance
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     block_device_info)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/driver.py", line 284, in migrate_disk_and_power_off
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     dest, instance_type, block_device_info)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 939, in migrate_disk_and_power_off
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     context, instance, dest, vm_ref, sr_path)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 882, in _migrate_disk_resizing_up
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     self._migrate_vhd(instance, vdi_uuid, dest, sr_path, seq_num)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 770, in _migrate_vhd
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     raise exception.MigrationError(reason=msg)
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp MigrationError: Migration error: Failed to transfer vhd to new host
2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: nova resize xenserver

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1262601

Title:
  Can't do "resize" on shared storage

Status in OpenStack Compute (Nova):
  New

Bug description:
  Can't do "resize" to instance (at least to bigger flavor) on shared storage using XenServer as hypervisor.
  Additionaly, if fails to "resize", VM is crashed too, I don't get a way to restore it in OpenStack. In XenServer VM is running, but by different name:

  Before - instance-00000031
  After - instance-00000031-orig

  2013-12-19 12:41:20.549 7888 ERROR nova.compute.manager [req-618c5498-3a38-4a34-a763-07e2c0c2cdeb 9ffbc08b941540c69a804ecfa4d3dc4e 76619aca43f841e0bed1a3b89ce8b426] [instance: e6903021-bdee-4f59-ad31-6cc686851eaa] Setting instance vm_state to ERROR
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa] Traceback (most recent call last):
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4967, in _error_out_instance_on_exception
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     yield
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3021, in resize_instance
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     block_device_info)
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/driver.py", line 284, in migrate_disk_and_power_off
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     dest, instance_type, block_device_info)
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 939, in migrate_disk_and_power_off
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     context, instance, dest, vm_ref, sr_path)
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 882, in _migrate_disk_resizing_up
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     self._migrate_vhd(instance, vdi_uuid, dest, sr_path, seq_num)
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 770, in _migrate_vhd
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]     raise exception.MigrationError(reason=msg)
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa] MigrationError: Migration error: Failed to transfer vhd to new host
  2013-12-19 12:41:20.549 7888 TRACE nova.compute.manager [instance: e6903021-bdee-4f59-ad31-6cc686851eaa]
  2013-12-19 12:41:20.956 7888 ERROR nova.openstack.common.rpc.amqp [req-618c5498-3a38-4a34-a763-07e2c0c2cdeb 9ffbc08b941540c69a804ecfa4d3dc4e 76619aca43f841e0bed1a3b89ce8b426] Exception during message handling
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     **args)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 353, in decorated_function
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 90, in wrapped
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     payload)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 73, in wrapped
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 243, in decorated_function
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     pass
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 229, in decorated_function
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 294, in decorated_function
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 271, in decorated_function
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 258, in decorated_function
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3021, in resize_instance
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     block_device_info)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/driver.py", line 284, in migrate_disk_and_power_off
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     dest, instance_type, block_device_info)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 939, in migrate_disk_and_power_off
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     context, instance, dest, vm_ref, sr_path)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 882, in _migrate_disk_resizing_up
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     self._migrate_vhd(instance, vdi_uuid, dest, sr_path, seq_num)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/xenapi/vmops.py", line 770, in _migrate_vhd
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp     raise exception.MigrationError(reason=msg)
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp MigrationError: Migration error: Failed to transfer vhd to new host
  2013-12-19 12:41:20.956 7888 TRACE nova.openstack.common.rpc.amqp

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1262601/+subscriptions
Follow ups

[Bug 1262601] Re: Can't do "resize" on shared storage
From: John Garbutt, 2014-03-13
[Bug 1262601] [NEW] Can't do "resize" on shared storage
From: Martins Jakubovics, 2013-12-19
References

[Bug 1262601] [NEW] Can't do "resize" on shared storage
From: Martins Jakubovics, 2013-12-19