yahoo-eng-team team mailing list archive

[weisongf <songwei-8@xxxxxxx>]

Public bug reported:

OpenStack verison Pike.

1.memory_remaining_bytes does not decrease

```
nova server-migration-show 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3 2971
+------------------------+--------------------------------------+
| Property | Value |
+------------------------+--------------------------------------+
| created_at | 2019-12-12T05:38:12.000000 |
| dest_compute | cmp063 |
| dest_host | - |
| dest_node | - |
| disk_processed_bytes | 0 |
| disk_remaining_bytes | 0 |
| disk_total_bytes | 0 |
| id | 2971 |
| memory_processed_bytes | 33290950593 |
| memory_remaining_bytes | 20959232 |
| memory_total_bytes | 34364792832 |
| server_uuid | 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3 |
| source_compute | cmp013 |
| source_node | - |
| status | running |
| updated_at | 2019-12-12T05:44:07.000000 |
+------------------------+--------------------------------------+
```
2.nova-compute logs No migration process log after 2% memory remaining
3.abort migration failed
```
2019-12-12 14:31:04,844.844 13398 ERROR nova.virt.libvirt.driver [req-2c8d930b-1a2e-4062-9482-aec0293f675c 78b7f111ca204778858e15d18a3e50a7 d3a063c353814be2957c305396181623 - default default] [instance: 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3] Failed to cancel migration Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats): libvirtError: Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats)
2019-12-12 14:31:04,924.924 13398 ERROR oslo_messaging.rpc.server [req-2c8d930b-1a2e-4062-9482-aec0293f675c 78b7f111ca204778858e15d18a3e50a7 d3a063c353814be2957c305396181623 - default default] Exception during message handling: libvirtError: Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats)

```

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1856923

Title:
  Virtual machine hot migration failed, no prompt timeout

Status in OpenStack Compute (nova):
  New

Bug description:
  OpenStack verison Pike.

  1.memory_remaining_bytes does not decrease

  ```
  nova server-migration-show 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3 2971
  +------------------------+--------------------------------------+
  | Property | Value |
  +------------------------+--------------------------------------+
  | created_at | 2019-12-12T05:38:12.000000 |
  | dest_compute | cmp063 |
  | dest_host | - |
  | dest_node | - |
  | disk_processed_bytes | 0 |
  | disk_remaining_bytes | 0 |
  | disk_total_bytes | 0 |
  | id | 2971 |
  | memory_processed_bytes | 33290950593 |
  | memory_remaining_bytes | 20959232 |
  | memory_total_bytes | 34364792832 |
  | server_uuid | 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3 |
  | source_compute | cmp013 |
  | source_node | - |
  | status | running |
  | updated_at | 2019-12-12T05:44:07.000000 |
  +------------------------+--------------------------------------+
  ```
  2.nova-compute logs No migration process log after 2% memory remaining
  3.abort migration failed
  ```
  2019-12-12 14:31:04,844.844 13398 ERROR nova.virt.libvirt.driver [req-2c8d930b-1a2e-4062-9482-aec0293f675c 78b7f111ca204778858e15d18a3e50a7 d3a063c353814be2957c305396181623 - default default] [instance: 675bcaf1-a9ab-452a-8b0f-be57f5b63cd3] Failed to cancel migration Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats): libvirtError: Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats)
  2019-12-12 14:31:04,924.924 13398 ERROR oslo_messaging.rpc.server [req-2c8d930b-1a2e-4062-9482-aec0293f675c 78b7f111ca204778858e15d18a3e50a7 d3a063c353814be2957c305396181623 - default default] Exception during message handling: libvirtError: Timed out during operation: cannot acquire state change lock (held by remoteDispatchDomainGetJobStats)

  ```

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1856923/+subscriptions