← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #13253

[Bug 1303536] [NEW] Live migration fails. XML error: CPU feature `wdt' specified more than once

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

Description of problem
---------------------------

Live migration fails.
libvirt says "XML error: CPU feature `wdt' specified more than once"

Version
---------

ii  libvirt-bin                                         1.2.2-0ubuntu2                        amd64        programs for the libvirt library
ii  python-libvirt                                      1.2.2-0ubuntu1                        amd64        libvirt Python bindings
ii  nova-compute                                        1:2014.1~b3-0ubuntu2                  all          OpenStack Compute - compute node base
ii  nova-compute-kvm                                    1:2014.1~b3-0ubuntu2                  all          OpenStack Compute - compute node (KVM)
ii  nova-cert                                           1:2014.1~b3-0ubuntu2                  all          OpenStack Compute - certificate management

DISTRIB_ID=Ubuntu
DISTRIB_RELEASE=14.04
DISTRIB_CODENAME=trusty
DISTRIB_DESCRIPTION="Ubuntu Trusty Tahr (development branch)"
NAME="Ubuntu"
VERSION="14.04, Trusty Tahr"


Test env
----------

A two node openstack havana on ubuntu 14.04. Migrating a instance to
other node.


Steps to Reproduce
------------------
 - Migrate the instance


And observe /var/log/nova/compute.log and /var/log/libvirt.log

Actual results
--------------

/var/log/nova-conductor.log

2014-04-04 13:42:17.128 3294 ERROR oslo.messaging._drivers.common [-] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n    result = getattr(endpoint, method)(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/server.py", line 139, in inner\n    return func(*args, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 668, in migrate_server\n    block_migration, disk_over_commit)\n', '  File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 769, in _live_migrate\n    raise exception.MigrationError(reason=ex)\n', 'MigrationError: Migration error: Remote error: libvirtError XML error: CPU feature `wdt\' specified more than once\n[u\'Traceback (most recent call last):\\n\', u\'  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\\n    incoming.message))\\n\', u\'  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\\n    return self._do_dispatch(endpoint, method, ctxt, args)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\\n    result = getattr(endpoint, method)(ctxt, **new_args)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped\\n    payload)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\\n    six.reraise(self.type_, self.value, self.tb)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped\\n    return f(self, context, *args, **kw)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 272, in decorated_function\\n    e, sys.exc_info())\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\\n    six.reraise(self.type_, self.value, self.tb)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 259, in decorated_function\\n    return function(self, context, *args, **kwargs)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4159, in check_can_live_migrate_destination\\n    block_migration, disk_over_commit)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4094, in check_can_live_migrate_destination\\n    self._compare_cpu(source_cpu_info)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4236, in _compare_cpu\\n    LOG.error(m, {\\\'ret\\\': ret, \\\'u\\\': u})\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\\n    six.reraise(self.type_, self.value, self.tb)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4232, in _compare_cpu\\n    ret = self._conn.compareCPU(cpu.to_xml(), 0)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit\\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call\\n    rv = execute(f,*args,**kwargs)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker\\n    rv = meth(*args,**kwargs)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/libvirt.py", line 3191, in compareCPU\\n    if ret == -1: raise libvirtError (\\\'virConnectCompareCPU() failed\\\', conn=self)\\n\', u"libvirtError: XML error: CPU feature `wdt\' specified more than once\\n"].\n']
2014-04-04 13:52:18.161 3295 ERROR nova.conductor.manager [req-471d2933-354a-4417-af50-c48399e19663 42fab7a8b7434bfc8473767c01e8378d b1cf6337c229491c96ad6e0a96e82979] Migration of instance 47d1fe7d-b812-4588-85eb-aa813267fc82 to host c2 unexpectedly failed.


/var/log/libvirtd.log

2014-03-27 18:23:17.141+0000: 2659: info : libvirt version: 1.2.2
2014-03-27 18:23:17.141+0000: 2659: error : virCPUDefParseXML:413 : XML error: CPU feature `wdt' specified more than once


Expected results
----------------
Successful migration


Additional info
----------------

Related with: https://bugs.launchpad.net/nova/+bug/1267191

On the file /usr/lib/python2.7/dist-
packages/nova/virt/libvirt/driver.py, the list info['features'] have the
duplicate feature.

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: compute libvirt

** Patch added: "temporal fix"
   https://bugs.launchpad.net/bugs/1303536/+attachment/4070625/+files/0001-fix-feature.patch

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1303536

Title:
  Live migration fails. XML error: CPU feature `wdt' specified more than
  once

Status in OpenStack Compute (Nova):
  New

Bug description:
  Description of problem
  ---------------------------

  Live migration fails.
  libvirt says "XML error: CPU feature `wdt' specified more than once"

  Version
  ---------

  ii  libvirt-bin                                         1.2.2-0ubuntu2                        amd64        programs for the libvirt library
  ii  python-libvirt                                      1.2.2-0ubuntu1                        amd64        libvirt Python bindings
  ii  nova-compute                                        1:2014.1~b3-0ubuntu2                  all          OpenStack Compute - compute node base
  ii  nova-compute-kvm                                    1:2014.1~b3-0ubuntu2                  all          OpenStack Compute - compute node (KVM)
  ii  nova-cert                                           1:2014.1~b3-0ubuntu2                  all          OpenStack Compute - certificate management

  DISTRIB_ID=Ubuntu
  DISTRIB_RELEASE=14.04
  DISTRIB_CODENAME=trusty
  DISTRIB_DESCRIPTION="Ubuntu Trusty Tahr (development branch)"
  NAME="Ubuntu"
  VERSION="14.04, Trusty Tahr"

  
  Test env
  ----------

  A two node openstack havana on ubuntu 14.04. Migrating a instance to
  other node.

  
  Steps to Reproduce
  ------------------
   - Migrate the instance

  
  And observe /var/log/nova/compute.log and /var/log/libvirt.log

  Actual results
  --------------

  /var/log/nova-conductor.log

  2014-04-04 13:42:17.128 3294 ERROR oslo.messaging._drivers.common [-] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\n    result = getattr(endpoint, method)(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/server.py", line 139, in inner\n    return func(*args, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 668, in migrate_server\n    block_migration, disk_over_commit)\n', '  File "/usr/lib/python2.7/dist-packages/nova/conductor/manager.py", line 769, in _live_migrate\n    raise exception.MigrationError(reason=ex)\n', 'MigrationError: Migration error: Remote error: libvirtError XML error: CPU feature `wdt\' specified more than once\n[u\'Traceback (most recent call last):\\n\', u\'  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply\\n    incoming.message))\\n\', u\'  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch\\n    return self._do_dispatch(endpoint, method, ctxt, args)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch\\n    result = getattr(endpoint, method)(ctxt, **new_args)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped\\n    payload)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\\n    six.reraise(self.type_, self.value, self.tb)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped\\n    return f(self, context, *args, **kw)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 272, in decorated_function\\n    e, sys.exc_info())\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\\n    six.reraise(self.type_, self.value, self.tb)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 259, in decorated_function\\n    return function(self, context, *args, **kwargs)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 4159, in check_can_live_migrate_destination\\n    block_migration, disk_over_commit)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4094, in check_can_live_migrate_destination\\n    self._compare_cpu(source_cpu_info)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4236, in _compare_cpu\\n    LOG.error(m, {\\\'ret\\\': ret, \\\'u\\\': u})\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 68, in __exit__\\n    six.reraise(self.type_, self.value, self.tb)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 4232, in _compare_cpu\\n    ret = self._conn.compareCPU(cpu.to_xml(), 0)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit\\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call\\n    rv = execute(f,*args,**kwargs)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker\\n    rv = meth(*args,**kwargs)\\n\', u\'  File "/usr/lib/python2.7/dist-packages/libvirt.py", line 3191, in compareCPU\\n    if ret == -1: raise libvirtError (\\\'virConnectCompareCPU() failed\\\', conn=self)\\n\', u"libvirtError: XML error: CPU feature `wdt\' specified more than once\\n"].\n']
  2014-04-04 13:52:18.161 3295 ERROR nova.conductor.manager [req-471d2933-354a-4417-af50-c48399e19663 42fab7a8b7434bfc8473767c01e8378d b1cf6337c229491c96ad6e0a96e82979] Migration of instance 47d1fe7d-b812-4588-85eb-aa813267fc82 to host c2 unexpectedly failed.

  
  /var/log/libvirtd.log

  2014-03-27 18:23:17.141+0000: 2659: info : libvirt version: 1.2.2
  2014-03-27 18:23:17.141+0000: 2659: error : virCPUDefParseXML:413 : XML error: CPU feature `wdt' specified more than once

  
  Expected results
  ----------------
  Successful migration

  
  Additional info
  ----------------

  Related with: https://bugs.launchpad.net/nova/+bug/1267191

  On the file /usr/lib/python2.7/dist-
  packages/nova/virt/libvirt/driver.py, the list info['features'] have
  the duplicate feature.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1303536/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next