yahoo-eng-team team mailing list archive

[Paul Carlton <paul.carlton2@xxxxxxx>]

** Changed in: nova
       Status: Invalid => New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1583145

Title:
  Live migration of large ephemeral disks result in progress_timeout

Status in OpenStack Compute (nova):
  New

Bug description:
  Live-migration monitoring is based on the memory migration only. Which
  means that if a live-migration is taking a long time to migrate a
  disk, only the live_migration_progress_timeout parameter will be taken
  into account and will override the live_migration_completion_timeout
  parameter. In other words, because live_migration_progress_timeout is
  logically smaller than live_migration_completion_timeout, the later
  will never be used except in a case where the disk migration is fast
  and the memory migration is slow.

  Steps to reproduce:
  - live-migrate an instance with lots a data on its ephemeral disk
  - observe that the live-migration is aborted because of live_migration_progress_timeout only.

  A bit of log with the original values (live_migration_progress_timeout
  = 150 seconds and live_migration_completion_timeout = 800 seconds):

  2016-05-25 08:59:30.344 3384 DEBUG nova.virt.libvirt.driver [req-3b2aab7c-5f43-494a-b9d2-a02a35d22fa1 c3eeb0123cf644889e157543da99ae48 b2657f1b7b86474baccf55faac526e5a] [instance: 46495844-fd23-448b-9e61-c5ffdb636155] Migration running for 145 secs, memory 100% remaining; (bytes processed=0, remaining=0, total=0) _live_migration_monitor /opt/stack/venv/nova-20160511T210741Z/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:6422
  2016-05-25 08:59:30.845 3384 WARNING nova.virt.libvirt.driver [req-3b2aab7c-5f43-494a-b9d2-a02a35d22fa1 c3eeb0123cf644889e157543da99ae48 b2657f1b7b86474baccf55faac526e5a] [instance: 46495844-fd23-448b-9e61-c5ffdb636155] Live migration stuck for 150 sec
  2016-05-25 08:59:31.590 3384 DEBUG nova.virt.libvirt.driver [req-3b2aab7c-5f43-494a-b9d2-a02a35d22fa1 c3eeb0123cf644889e157543da99ae48 b2657f1b7b86474baccf55faac526e5a] [instance: 46495844-fd23-448b-9e61-c5ffdb636155] Live migration monitoring is all done _live_migration /opt/stack/venv/nova-20160511T210741Z/lib/python2.7/site-packages/nova/virt/libvirt/driver.py:6526
  2016-05-25 08:59:31.818 3384 ERROR nova.virt.libvirt.driver [req-3b2aab7c-5f43-494a-b9d2-a02a35d22fa1 c3eeb0123cf644889e157543da99ae48 b2657f1b7b86474baccf55faac526e5a] [instance: 46495844-fd23-448b-9e61-c5ffdb636155] Live Migration failure: operation aborted: migration out: canceled by client

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1583145/+subscriptions