← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1373949] [NEW] live-migration fails because of CPU feature invtsc

 

Public bug reported:

Hi!

I'm running the latest git nova code from branch stable/icehouse and have patched it to get rid of the "duplicate feature bug"
(commit 0f28fbef8bedeafca0bf488b84f783568fefc960).
I'm running libvirt 1.2.8 and qemu 2.0.2.

When I issue the command to do a live migration it fails with this stack
trace:

2014-09-25 13:51:46.837 16995 ERROR nova.virt.libvirt.driver [-] [instance: 3b8dbddc-ba24-4ec6-bb3b-be227b5fb689] Live Migration failure: Requested operation is not valid: domain has CPU feature: invtsc
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/eventlet/hubs/poll.py", line 97, in wait
readers.get(fileno, noop).cb(fileno)
File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 194, in main
result = function(*args, **kwargs)
File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4595, in _live_migration
recover_method(context, instance, dest, block_migration)
File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
six.reraise(self.type_, self.value, self.tb)
File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4589, in _live_migration
CONF.libvirt.live_migration_bandwidth)
File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 179, in doit
result = proxy_call(self._autowrap, f, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 139, in proxy_call
rv = execute(f,*args,**kwargs)
File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 77, in tworker
rv = meth(*args,**kwargs)
File "/usr/lib/python2.7/site-packages/libvirt.py", line 1590, in migrateToURI
if ret == -1: raise libvirtError ('virDomainMigrateToURI() failed', dom=self)
libvirtError: Requested operation is not valid: domain has CPU feature: invtsc

when googling for invtsc it seems to be fairly new feature in libvirt
(http://www.redhat.com/archives/libvir-list/2014-May/msg00214.html),
which might be the reason this has not showed up for other people that
use ubuntu for example.

Regards
Daniel Lundqvist

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: libvirt live-migration

** Description changed:

  Hi!
  
  I'm running the latest git nova code from brach stable/icehouse and have patched it to get rid of the "duplicate feature bug".
  I'm running libvirt 1.2.8 and qemu 2.0.2.
  
- When I issue the command to do a live migration gets stuck with this
- stack trace:
+ When I issue the command to do a live migration it fails with this stack
+ trace:
  
  2014-09-25 13:51:46.837 16995 ERROR nova.virt.libvirt.driver [-] [instance: 3b8dbddc-ba24-4ec6-bb3b-be227b5fb689] Live Migration failure: Requested operation is not valid: domain has CPU feature: invtsc
  Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/eventlet/hubs/poll.py", line 97, in wait
  readers.get(fileno, noop).cb(fileno)
  File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 194, in main
  result = function(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4595, in _live_migration
  recover_method(context, instance, dest, block_migration)
  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  six.reraise(self.type_, self.value, self.tb)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4589, in _live_migration
  CONF.libvirt.live_migration_bandwidth)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 179, in doit
  result = proxy_call(self._autowrap, f, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 139, in proxy_call
  rv = execute(f,*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 77, in tworker
  rv = meth(*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/libvirt.py", line 1590, in migrateToURI
  if ret == -1: raise libvirtError ('virDomainMigrateToURI() failed', dom=self)
  libvirtError: Requested operation is not valid: domain has CPU feature: invtsc
  
- 
- when googling for invtsc it seems to be fairly new feature in libvirt (http://www.redhat.com/archives/libvir-list/2014-May/msg00214.html), which might be the reason this has not showed up for other people that use ubuntu for example. 
+ when googling for invtsc it seems to be fairly new feature in libvirt
+ (http://www.redhat.com/archives/libvir-list/2014-May/msg00214.html),
+ which might be the reason this has not showed up for other people that
+ use ubuntu for example.
  
  Regards
  Daniel Lundqvist

** Description changed:

  Hi!
  
- I'm running the latest git nova code from brach stable/icehouse and have patched it to get rid of the "duplicate feature bug".
+ I'm running the latest git nova code from branch stable/icehouse and have patched it to get rid of the "duplicate feature bug".
  I'm running libvirt 1.2.8 and qemu 2.0.2.
  
  When I issue the command to do a live migration it fails with this stack
  trace:
  
  2014-09-25 13:51:46.837 16995 ERROR nova.virt.libvirt.driver [-] [instance: 3b8dbddc-ba24-4ec6-bb3b-be227b5fb689] Live Migration failure: Requested operation is not valid: domain has CPU feature: invtsc
  Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/eventlet/hubs/poll.py", line 97, in wait
  readers.get(fileno, noop).cb(fileno)
  File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 194, in main
  result = function(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4595, in _live_migration
  recover_method(context, instance, dest, block_migration)
  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  six.reraise(self.type_, self.value, self.tb)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4589, in _live_migration
  CONF.libvirt.live_migration_bandwidth)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 179, in doit
  result = proxy_call(self._autowrap, f, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 139, in proxy_call
  rv = execute(f,*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 77, in tworker
  rv = meth(*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/libvirt.py", line 1590, in migrateToURI
  if ret == -1: raise libvirtError ('virDomainMigrateToURI() failed', dom=self)
  libvirtError: Requested operation is not valid: domain has CPU feature: invtsc
  
  when googling for invtsc it seems to be fairly new feature in libvirt
  (http://www.redhat.com/archives/libvir-list/2014-May/msg00214.html),
  which might be the reason this has not showed up for other people that
  use ubuntu for example.
  
  Regards
  Daniel Lundqvist

** Description changed:

  Hi!
  
- I'm running the latest git nova code from branch stable/icehouse and have patched it to get rid of the "duplicate feature bug".
+ I'm running the latest git nova code from branch stable/icehouse and have patched it to get rid of the "duplicate feature bug" (commit 0f28fbef8bedeafca0bf488b84f783568fefc960).
  I'm running libvirt 1.2.8 and qemu 2.0.2.
  
  When I issue the command to do a live migration it fails with this stack
  trace:
  
  2014-09-25 13:51:46.837 16995 ERROR nova.virt.libvirt.driver [-] [instance: 3b8dbddc-ba24-4ec6-bb3b-be227b5fb689] Live Migration failure: Requested operation is not valid: domain has CPU feature: invtsc
  Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/eventlet/hubs/poll.py", line 97, in wait
  readers.get(fileno, noop).cb(fileno)
  File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 194, in main
  result = function(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4595, in _live_migration
  recover_method(context, instance, dest, block_migration)
  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  six.reraise(self.type_, self.value, self.tb)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4589, in _live_migration
  CONF.libvirt.live_migration_bandwidth)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 179, in doit
  result = proxy_call(self._autowrap, f, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 139, in proxy_call
  rv = execute(f,*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 77, in tworker
  rv = meth(*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/libvirt.py", line 1590, in migrateToURI
  if ret == -1: raise libvirtError ('virDomainMigrateToURI() failed', dom=self)
  libvirtError: Requested operation is not valid: domain has CPU feature: invtsc
  
  when googling for invtsc it seems to be fairly new feature in libvirt
  (http://www.redhat.com/archives/libvir-list/2014-May/msg00214.html),
  which might be the reason this has not showed up for other people that
  use ubuntu for example.
  
  Regards
  Daniel Lundqvist

** Description changed:

  Hi!
  
- I'm running the latest git nova code from branch stable/icehouse and have patched it to get rid of the "duplicate feature bug" (commit 0f28fbef8bedeafca0bf488b84f783568fefc960).
+ I'm running the latest git nova code from branch stable/icehouse and have patched it to get rid of the "duplicate feature bug"
+ (commit 0f28fbef8bedeafca0bf488b84f783568fefc960).
  I'm running libvirt 1.2.8 and qemu 2.0.2.
  
  When I issue the command to do a live migration it fails with this stack
  trace:
  
  2014-09-25 13:51:46.837 16995 ERROR nova.virt.libvirt.driver [-] [instance: 3b8dbddc-ba24-4ec6-bb3b-be227b5fb689] Live Migration failure: Requested operation is not valid: domain has CPU feature: invtsc
  Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/eventlet/hubs/poll.py", line 97, in wait
  readers.get(fileno, noop).cb(fileno)
  File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 194, in main
  result = function(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4595, in _live_migration
  recover_method(context, instance, dest, block_migration)
  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  six.reraise(self.type_, self.value, self.tb)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4589, in _live_migration
  CONF.libvirt.live_migration_bandwidth)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 179, in doit
  result = proxy_call(self._autowrap, f, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 139, in proxy_call
  rv = execute(f,*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 77, in tworker
  rv = meth(*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/libvirt.py", line 1590, in migrateToURI
  if ret == -1: raise libvirtError ('virDomainMigrateToURI() failed', dom=self)
  libvirtError: Requested operation is not valid: domain has CPU feature: invtsc
  
  when googling for invtsc it seems to be fairly new feature in libvirt
  (http://www.redhat.com/archives/libvir-list/2014-May/msg00214.html),
  which might be the reason this has not showed up for other people that
  use ubuntu for example.
  
  Regards
  Daniel Lundqvist

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1373949

Title:
  live-migration fails because of CPU feature invtsc

Status in OpenStack Compute (Nova):
  New

Bug description:
  Hi!

  I'm running the latest git nova code from branch stable/icehouse and have patched it to get rid of the "duplicate feature bug"
  (commit 0f28fbef8bedeafca0bf488b84f783568fefc960).
  I'm running libvirt 1.2.8 and qemu 2.0.2.

  When I issue the command to do a live migration it fails with this
  stack trace:

  2014-09-25 13:51:46.837 16995 ERROR nova.virt.libvirt.driver [-] [instance: 3b8dbddc-ba24-4ec6-bb3b-be227b5fb689] Live Migration failure: Requested operation is not valid: domain has CPU feature: invtsc
  Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/eventlet/hubs/poll.py", line 97, in wait
  readers.get(fileno, noop).cb(fileno)
  File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 194, in main
  result = function(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4595, in _live_migration
  recover_method(context, instance, dest, block_migration)
  File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  six.reraise(self.type_, self.value, self.tb)
  File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4589, in _live_migration
  CONF.libvirt.live_migration_bandwidth)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 179, in doit
  result = proxy_call(self._autowrap, f, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 139, in proxy_call
  rv = execute(f,*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 77, in tworker
  rv = meth(*args,**kwargs)
  File "/usr/lib/python2.7/site-packages/libvirt.py", line 1590, in migrateToURI
  if ret == -1: raise libvirtError ('virDomainMigrateToURI() failed', dom=self)
  libvirtError: Requested operation is not valid: domain has CPU feature: invtsc

  when googling for invtsc it seems to be fairly new feature in libvirt
  (http://www.redhat.com/archives/libvir-list/2014-May/msg00214.html),
  which might be the reason this has not showed up for other people that
  use ubuntu for example.

  Regards
  Daniel Lundqvist

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1373949/+subscriptions


Follow ups

References