yahoo-eng-team team mailing list archive

[Matt Riedemann <mriedem.os@xxxxxxxxx>]

Public bug reported:

This CI job failed on a Queens patch:

http://logs.openstack.org/07/516707/23/check/legacy-tempest-dsvm-
multinode-live-migration/d9089b2/job-
output.txt.gz#_2017-12-11_20_29_09_364369

This is the corresponding QEMU guest log:

http://logs.openstack.org/07/516707/23/check/legacy-tempest-dsvm-
multinode-live-migration/d9089b2/logs/libvirt/qemu/instance-
0000000a.txt.gz

2017-12-11T20:28:17.493781Z qemu-system-x86_64: VQ 0 size 0x80 Guest index 0x11f inconsistent with Host index 0x121: delta 0xfffe
2017-12-11T20:28:17.493803Z qemu-system-x86_64: Failed to load virtio-blk:virtio
2017-12-11T20:28:17.493807Z qemu-system-x86_64: error while loading state for instance 0x0 of device '0000:00:03.0/virtio-blk'
2017-12-11T20:28:17.493874Z qemu-system-x86_64: load of migration failed: Operation not permitted
2017-12-11 20:28:17.494+0000: shutting down, reason=failed

This is the failure in the nova-compute logs:

http://logs.openstack.org/07/516707/23/check/legacy-tempest-dsvm-
multinode-live-
migration/d9089b2/logs/subnode-2/screen-n-cpu.txt.gz?level=TRACE#_Dec_11_20_28_17_768795

Dec 11 20:28:17.768795 ubuntu-xenial-ovh-bhs1-0001369824 nova-compute[2304]: ERROR nova.virt.libvirt.driver [None req-8bd84a16-a341-441f-afbb-b35c3decb59a service nova] [instance: 58d015a2-4793-497c-a973-99b9dc881f04] Live Migration failure: operation failed: job: unexpectedly failed: libvirtError: operation failed: job: unexpectedly failed
Dec 11 20:28:17.834511 ubuntu-xenial-ovh-bhs1-0001369824 nova-compute[2304]: ERROR nova.virt.libvirt.driver [None req-8bd84a16-a341-441f-afbb-b35c3decb59a service nova] [instance: 58d015a2-4793-497c-a973-99b9dc881f04] Migration operation has aborted

** Affects: nova
     Importance: Undecided
         Status: Confirmed


** Tags: libvirt live-migration

** Tags removed: live-
** Tags added: live-migration

** Changed in: nova
       Status: New => Confirmed

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1737625

Title:
  live migration failed with "Failed to load virtio-blk:virtio"
  (libvirt/qemu)

Status in OpenStack Compute (nova):
  Confirmed

Bug description:
  This CI job failed on a Queens patch:

  http://logs.openstack.org/07/516707/23/check/legacy-tempest-dsvm-
  multinode-live-migration/d9089b2/job-
  output.txt.gz#_2017-12-11_20_29_09_364369

  This is the corresponding QEMU guest log:

  http://logs.openstack.org/07/516707/23/check/legacy-tempest-dsvm-
  multinode-live-migration/d9089b2/logs/libvirt/qemu/instance-
  0000000a.txt.gz

  2017-12-11T20:28:17.493781Z qemu-system-x86_64: VQ 0 size 0x80 Guest index 0x11f inconsistent with Host index 0x121: delta 0xfffe
  2017-12-11T20:28:17.493803Z qemu-system-x86_64: Failed to load virtio-blk:virtio
  2017-12-11T20:28:17.493807Z qemu-system-x86_64: error while loading state for instance 0x0 of device '0000:00:03.0/virtio-blk'
  2017-12-11T20:28:17.493874Z qemu-system-x86_64: load of migration failed: Operation not permitted
  2017-12-11 20:28:17.494+0000: shutting down, reason=failed

  This is the failure in the nova-compute logs:

  http://logs.openstack.org/07/516707/23/check/legacy-tempest-dsvm-
  multinode-live-
  migration/d9089b2/logs/subnode-2/screen-n-cpu.txt.gz?level=TRACE#_Dec_11_20_28_17_768795

  Dec 11 20:28:17.768795 ubuntu-xenial-ovh-bhs1-0001369824 nova-compute[2304]: ERROR nova.virt.libvirt.driver [None req-8bd84a16-a341-441f-afbb-b35c3decb59a service nova] [instance: 58d015a2-4793-497c-a973-99b9dc881f04] Live Migration failure: operation failed: job: unexpectedly failed: libvirtError: operation failed: job: unexpectedly failed
  Dec 11 20:28:17.834511 ubuntu-xenial-ovh-bhs1-0001369824 nova-compute[2304]: ERROR nova.virt.libvirt.driver [None req-8bd84a16-a341-441f-afbb-b35c3decb59a service nova] [instance: 58d015a2-4793-497c-a973-99b9dc881f04] Migration operation has aborted

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1737625/+subscriptions