yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1278066] [NEW] live migrate is failing

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Ami Jeain <ajeain@xxxxxxxxxx>
Date: Sun, 09 Feb 2014 12:18:55 -0000
Reply-to: Bug 1278066 <1278066@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

I have a setup of 1 controller and 2 computes.
I have an instance which I try to live-migrate from one compute server to another, and It gives an error "failed to live migrate....".
I looked at the /var/log/nova/compute.log and it shows the following exception:

2014-02-09 12:05:14.072 19968 ERROR nova.openstack.common.rpc.amqp [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] Exception during message handling
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     **args)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 90, in wrapped
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     payload)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 73, in wrapped
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4083, in check_can_live_migrate_destination
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     block_migration, disk_over_commit)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3968, in check_can_live_migrate_destination
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     self._compare_cpu(source_cpu_info)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4110, in _compare_cpu
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     LOG.error(m, {'ret': ret, 'u': u})
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4106, in _compare_cpu
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     ret = self._conn.compareCPU(cpu.to_xml(), 0)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 187, in doit
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     result = proxy_call(self._autowrap, f, *args, **kwargs)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 147, in proxy_call
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     rv = execute(f,*args,**kwargs)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 76, in tworker
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     rv = meth(*args,**kwargs)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 2889, in compareCPU
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     if ret == -1: raise libvirtError ('virConnectCompareCPU() failed', conn=self)
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp libvirtError: XML error: CPU feature `pdpe1gb' specified more than once
2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp
2014-02-09 12:05:14.076 19968 ERROR nova.openstack.common.rpc.common [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] Returning exception XML error: CPU feature `pdpe1gb' specified more than once to caller
2014-02-09 12:05:14.076 19968 ERROR nova.openstack.common.rpc.common [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data\n    **args)\n', '  File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n    result = getattr(proxyobj, method)(ctxt, **kwargs)\n', '  File "/usr/lib/python2.7/site-packages/nova/exception.py", line 90, in wrapped\n    payload)\n', '  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n    six.reraise(self.type_, self.value, self.tb)\n', '  File "/usr/lib/python2.7/site-packages/nova/exception.py", line 73, in wrapped\n    return f(self, context, *args, **kw)\n', '  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4083, in check_can_live_migrate_destination\n    block_migration, disk_over_commit)\n', '  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3968, in check_can_live_migrate_destination\n    self._compare_cpu(source_cpu_info)\n', '  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4110, in _compare_cpu\n    LOG.error(m, {\'ret\': ret, \'u\': u})\n', '  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n    six.reraise(self.type_, self.value, self.tb)\n', '  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4106, in _compare_cpu\n    ret = self._conn.compareCPU(cpu.to_xml(), 0)\n', '  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 187, in doit\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\n', '  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 147, in proxy_call\n    rv = execute(f,*args,**kwargs)\n', '  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 76, in tworker\n    rv = meth(*args,**kwargs)\n', '  File "/usr/lib64/python2.7/site-packages/libvirt.py", line 2889, in compareCPU\n    if ret == -1: raise libvirtError (\'virConnectCompareCPU() failed\', conn=self)\n', "libvirtError: XML error: CPU feature `pdpe1gb' specified more than once\n"]

** Affects: horizon
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Dashboard (Horizon).
https://bugs.launchpad.net/bugs/1278066

Title:
  live migrate is failing

Status in OpenStack Dashboard (Horizon):
  New

Bug description:
  I have a setup of 1 controller and 2 computes.
  I have an instance which I try to live-migrate from one compute server to another, and It gives an error "failed to live migrate....".
  I looked at the /var/log/nova/compute.log and it shows the following exception:

  2014-02-09 12:05:14.072 19968 ERROR nova.openstack.common.rpc.amqp [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] Exception during message handling
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     **args)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 90, in wrapped
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     payload)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 73, in wrapped
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4083, in check_can_live_migrate_destination
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     block_migration, disk_over_commit)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3968, in check_can_live_migrate_destination
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     self._compare_cpu(source_cpu_info)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4110, in _compare_cpu
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     LOG.error(m, {'ret': ret, 'u': u})
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4106, in _compare_cpu
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     ret = self._conn.compareCPU(cpu.to_xml(), 0)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 187, in doit
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     result = proxy_call(self._autowrap, f, *args, **kwargs)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 147, in proxy_call
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     rv = execute(f,*args,**kwargs)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 76, in tworker
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     rv = meth(*args,**kwargs)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 2889, in compareCPU
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp     if ret == -1: raise libvirtError ('virConnectCompareCPU() failed', conn=self)
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp libvirtError: XML error: CPU feature `pdpe1gb' specified more than once
  2014-02-09 12:05:14.072 19968 TRACE nova.openstack.common.rpc.amqp
  2014-02-09 12:05:14.076 19968 ERROR nova.openstack.common.rpc.common [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] Returning exception XML error: CPU feature `pdpe1gb' specified more than once to caller
  2014-02-09 12:05:14.076 19968 ERROR nova.openstack.common.rpc.common [req-1722e387-ab40-4228-b1c5-27164f0b45d5 55ebc145eb954c6f933f588407af2753 e433ae32fee7468fad9e80d96f4e92a0] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/amqp.py", line 461, in _process_data\n    **args)\n', '  File "/usr/lib/python2.7/site-packages/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch\n    result = getattr(proxyobj, method)(ctxt, **kwargs)\n', '  File "/usr/lib/python2.7/site-packages/nova/exception.py", line 90, in wrapped\n    payload)\n', '  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n    six.reraise(self.type_, self.value, self.tb)\n', '  File "/usr/lib/python2.7/site-packages/nova/exception.py", line 73, in wrapped\n    return f(self, context, *args, **kw)\n', '  File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 4083, in check_can_live_migrate_destination\n    block_migration, disk_over_commit)\n', '  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3968, in check_can_live_migrate_destination\n    self._compare_cpu(source_cpu_info)\n', '  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4110, in _compare_cpu\n    LOG.error(m, {\'ret\': ret, \'u\': u})\n', '  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n    six.reraise(self.type_, self.value, self.tb)\n', '  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4106, in _compare_cpu\n    ret = self._conn.compareCPU(cpu.to_xml(), 0)\n', '  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 187, in doit\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\n', '  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 147, in proxy_call\n    rv = execute(f,*args,**kwargs)\n', '  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 76, in tworker\n    rv = meth(*args,**kwargs)\n', '  File "/usr/lib64/python2.7/site-packages/libvirt.py", line 2889, in compareCPU\n    if ret == -1: raise libvirtError (\'virConnectCompareCPU() failed\', conn=self)\n', "libvirtError: XML error: CPU feature `pdpe1gb' specified more than once\n"]

To manage notifications about this bug go to:
https://bugs.launchpad.net/horizon/+bug/1278066/+subscriptions
Follow ups

[Bug 1278066] Re: live migrate requires shared storage
From: Gary W. Smith, 2017-09-14
[Bug 1278066] [NEW] live migrate is failing
From: Ami Jeain, 2014-02-09
References

[Bug 1278066] [NEW] live migrate is failing
From: Ami Jeain, 2014-02-09