yahoo-eng-team team mailing list archive

[Matt Riedemann <mriedem.os@xxxxxxxxx>]

What is the configuration on your compute nodes? Do you have a timeout
set for live migration? Do you have post-copy or auto-converge enabled?
What version of libvirt and qemu binaries on those nodes?

I'm going to mark this as invalid per a support request until there is
more information to help debug this or you've gone through those docs on
configuring the nodes for live migration timeout actions.

** Changed in: nova
       Status: New => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1856923

Title:
  Virtual machine hot migration failed, no prompt timeout

Status in OpenStack Compute (nova):
  Invalid

Bug description:
  OpenStack verison Pike.

  1.memory_remaining_bytes does not decrease

  ```
  nova server-migration-show 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3 2971
  +------------------------+--------------------------------------+
  | Property | Value |
  +------------------------+--------------------------------------+
  | created_at | 2019-12-12T05:38:12.000000 |
  | dest_compute | cmp063 |
  | dest_host | - |
  | dest_node | - |
  | disk_processed_bytes | 0 |
  | disk_remaining_bytes | 0 |
  | disk_total_bytes | 0 |
  | id | 2971 |
  | memory_processed_bytes | 33290950593 |
  | memory_remaining_bytes | 20959232 |
  | memory_total_bytes | 34364792832 |
  | server_uuid | 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3 |
  | source_compute | cmp013 |
  | source_node | - |
  | status | running |
  | updated_at | 2019-12-12T05:44:07.000000 |
  +------------------------+--------------------------------------+
  ```
  2.nova-compute logs No migration process log after 2% memory remaining
  3.abort migration failed
  ```
  2019-12-12 14:31:04,844.844 13398 ERROR nova.virt.libvirt.driver [req-2c8d930b-1a2e-4062-9482-aec0293f675c 78b7f111ca204778858e15d18a3e50a7 d3a063c353814be2957c305396181623 - default default] [instance: 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3] Failed to cancel migration Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats): libvirtError: Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats)
  2019-12-12 14:31:04,924.924 13398 ERROR oslo_messaging.rpc.server [req-2c8d930b-1a2e-4062-9482-aec0293f675c 78b7f111ca204778858e15d18a3e50a7 d3a063c353814be2957c305396181623 - default default] Exception during message handling: libvirtError: Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats)

  ```

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1856923/+subscriptions