yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1777123] [NEW] Nova 17.04 fails to create ephemeral storage with rbd driver

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: "Dmitriy R." <noonedeadpunk@xxxxx>
Date: Fri, 15 Jun 2018 11:54:31 -0000
Reply-to: Bug 1777123 <1777123@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Description
===========

Nova-compute is unable to create ephemeral storage due to type error, as
it sends unicode object to rbd.Image() class as a storage name.
Meanwhile, rbd.Image() accepts only string value.


Steps to reproduce
==================

Try to create an instance without cinder drive or with flavor which has
a swap defined. Also, nova-compute should be configured to interact with
ceph.


Steps to fix the problem
==================
in nova/virt/libvirt/storage/rbd_utils.py make the following changes:
- L69:  self.volume = tpool.Proxy(rbd.Image(ioctx, name,
+ L69:  self.volume = tpool.Proxy(rbd.Image(ioctx, str(name),


Expected result
===============

Instance should be created with swap storage and/or with ephemeral drive
in ceph.


Actual result
=============
Instance creation fails with:

Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance bdd019bd-4127-4186-a1ee-f4b1891e1730.
File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/conductor/manager.py", line 580, in build_instances raise exception.MaxRetriesExceeded(reason=msg)


Environment
===========
1. I've installed openstack with OSA (OpenStack-Ansible) version 17.0.5. So it would be openstack queens version
(nova-17.0.5) root@uacloud-nova01:~# pip freeze | grep nova
nova==17.0.4
nova-lxd==17.0.0
nova-powervm==6.0.2.dev3
python-novaclient==9.1.1
(nova-17.0.5) root@uacloud-nova01:~#
2. KVM hypervisor
3. CEPH storage
4. Neutron networking


Logs & Configs
==============
In logs I see the following error:
2018-06-15 14:38:56.904 13411 INFO nova.compute.claims [req-b7277d7c-14b6-4f0c-97fb-bb29a6c379a5 cf35f21e050d462db0e0ecf20da2a9de d605898aeb654bfea6e18c3c0321d8a8 - 309afdf3dd6242338cd5eb4cda07f1d9 309afdf3dd6242338cd5eb4cda07f1d9] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] vcpu limit: 320.00 VCPU, free: 311.00 VCPU
2018-06-15 14:38:56.909 13411 INFO nova.compute.claims [req-b7277d7c-14b6-4f0c-97fb-bb29a6c379a5 cf35f21e050d462db0e0ecf20da2a9de d605898aeb654bfea6e18c3c0321d8a8 - 309afdf3dd6242338cd5eb4cda07f1d9 309afdf3dd6242338cd5eb4cda07f1d9] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Claim successful on node uacloud-nova01.twinservers.net
2018-06-15 14:38:57.837 13411 INFO nova.virt.libvirt.driver [req-b7277d7c-14b6-4f0c-97fb-bb29a6c379a5 cf35f21e050d462db0e0ecf20da2a9de d605898aeb654bfea6e18c3c0321d8a8 - 309afdf3dd6242338cd5eb4cda07f1d9 309afdf3dd6242338cd5eb4cda07f1d9] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Creating image
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [req-b7277d7c-14b6-4f0c-97fb-bb29a6c379a5 cf35f21e050d462db0e0ecf20da2a9de d605898aeb654bfea6e18c3c0321d8a8 - 309afdf3dd6242338cd5eb4cda07f1d9 309afdf3dd6242338cd5eb4cda07f1d9] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Instance failed to spawn: TypeError: name must be a string
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Traceback (most recent call last):
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/compute/manager.py", line 2248, in _build_resources
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     yield resources
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/compute/manager.py", line 2031, in _build_and_run_instance
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     block_device_info=block_device_info)
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3072, in spawn
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     block_device_info=block_device_info)
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3450, in _create_image
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     fallback_from_host)
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3541, in _create_and_inject_local_root
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     instance, size, fallback_from_host)
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 7679, in _try_fetch_image_cache
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     size=size)
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 241, in cache
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     if not self.exists() or not os.path.exists(base):
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 876, in exists
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     return self.driver.exists(self.rbd_name)
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 292, in exists
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     read_only=True):
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 71, in __init__
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     read_only=read_only))
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/usr/local/lib/python2.7/dist-packages/rbd.py", line 360, in __init__
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     raise TypeError('name must be a string')
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] TypeError: name must be a string
2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] 
2018-06-15 14:38:59.710 13411 INFO nova.compute.manager [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Terminating instance
2018-06-15 14:38:59.729 13411 INFO nova.virt.libvirt.driver [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Instance destroyed successfully.
2018-06-15 14:38:59.732 13411 INFO os_vif [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] Successfully unplugged vif VIFBridge(active=False,address=fa:16:3e:9a:6f:0e,bridge_name='brq1adccf1f-63',has_traffic_filtering=True,id=5ff5feac-cb04-46db-8580-0929efd4c6eb,network=Network(1adccf1f-639e-4c7a-8865-851893eeee9c),plugin='linux_bridge',port_profile=<?>,preserve_on_delete=False,vif_name='tap5ff5feac-cb')
2018-06-15 14:38:59.815 13411 INFO nova.virt.libvirt.driver [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Deleting instance files /var/lib/nova/instances/bdd019bd-4127-4186-a1ee-f4b1891e1730_del
2018-06-15 14:38:59.817 13411 INFO nova.virt.libvirt.driver [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Deletion of /var/lib/nova/instances/bdd019bd-4127-4186-a1ee-f4b1891e1730_del complete
2018-06-15 14:38:59.922 13411 INFO nova.compute.manager [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Took 0.20 seconds to destroy the instance on the hypervisor.
2018-06-15 14:39:00.773 13411 INFO nova.compute.manager [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Took 0.57 seconds to deallocate network for instance.
2018-06-15 14:39:00.978 13411 INFO nova.scheduler.client.report [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] Deleted allocation for instance bdd019bd-4127-4186-a1ee-f4b1891e1730

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: nova-compute openstack-version.queens

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1777123

Title:
  Nova 17.04 fails to create ephemeral storage with rbd driver

Status in OpenStack Compute (nova):
  New

Bug description:
  Description
  ===========

  Nova-compute is unable to create ephemeral storage due to type error,
  as it sends unicode object to rbd.Image() class as a storage name.
  Meanwhile, rbd.Image() accepts only string value.

  
  Steps to reproduce
  ==================

  Try to create an instance without cinder drive or with flavor which
  has a swap defined. Also, nova-compute should be configured to
  interact with ceph.

  
  Steps to fix the problem
  ==================
  in nova/virt/libvirt/storage/rbd_utils.py make the following changes:
  - L69:  self.volume = tpool.Proxy(rbd.Image(ioctx, name,
  + L69:  self.volume = tpool.Proxy(rbd.Image(ioctx, str(name),

  
  Expected result
  ===============

  Instance should be created with swap storage and/or with ephemeral
  drive in ceph.

  
  Actual result
  =============
  Instance creation fails with:

  Exceeded maximum number of retries. Exhausted all hosts available for retrying build failures for instance bdd019bd-4127-4186-a1ee-f4b1891e1730.
  File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/conductor/manager.py", line 580, in build_instances raise exception.MaxRetriesExceeded(reason=msg)

  
  Environment
  ===========
  1. I've installed openstack with OSA (OpenStack-Ansible) version 17.0.5. So it would be openstack queens version
  (nova-17.0.5) root@uacloud-nova01:~# pip freeze | grep nova
  nova==17.0.4
  nova-lxd==17.0.0
  nova-powervm==6.0.2.dev3
  python-novaclient==9.1.1
  (nova-17.0.5) root@uacloud-nova01:~#
  2. KVM hypervisor
  3. CEPH storage
  4. Neutron networking

  
  Logs & Configs
  ==============
  In logs I see the following error:
  2018-06-15 14:38:56.904 13411 INFO nova.compute.claims [req-b7277d7c-14b6-4f0c-97fb-bb29a6c379a5 cf35f21e050d462db0e0ecf20da2a9de d605898aeb654bfea6e18c3c0321d8a8 - 309afdf3dd6242338cd5eb4cda07f1d9 309afdf3dd6242338cd5eb4cda07f1d9] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] vcpu limit: 320.00 VCPU, free: 311.00 VCPU
  2018-06-15 14:38:56.909 13411 INFO nova.compute.claims [req-b7277d7c-14b6-4f0c-97fb-bb29a6c379a5 cf35f21e050d462db0e0ecf20da2a9de d605898aeb654bfea6e18c3c0321d8a8 - 309afdf3dd6242338cd5eb4cda07f1d9 309afdf3dd6242338cd5eb4cda07f1d9] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Claim successful on node uacloud-nova01.twinservers.net
  2018-06-15 14:38:57.837 13411 INFO nova.virt.libvirt.driver [req-b7277d7c-14b6-4f0c-97fb-bb29a6c379a5 cf35f21e050d462db0e0ecf20da2a9de d605898aeb654bfea6e18c3c0321d8a8 - 309afdf3dd6242338cd5eb4cda07f1d9 309afdf3dd6242338cd5eb4cda07f1d9] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Creating image
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [req-b7277d7c-14b6-4f0c-97fb-bb29a6c379a5 cf35f21e050d462db0e0ecf20da2a9de d605898aeb654bfea6e18c3c0321d8a8 - 309afdf3dd6242338cd5eb4cda07f1d9 309afdf3dd6242338cd5eb4cda07f1d9] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Instance failed to spawn: TypeError: name must be a string
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Traceback (most recent call last):
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/compute/manager.py", line 2248, in _build_resources
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     yield resources
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/compute/manager.py", line 2031, in _build_and_run_instance
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     block_device_info=block_device_info)
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3072, in spawn
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     block_device_info=block_device_info)
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3450, in _create_image
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     fallback_from_host)
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 3541, in _create_and_inject_local_root
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     instance, size, fallback_from_host)
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 7679, in _try_fetch_image_cache
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     size=size)
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 241, in cache
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     if not self.exists() or not os.path.exists(base):
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/imagebackend.py", line 876, in exists
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     return self.driver.exists(self.rbd_name)
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 292, in exists
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     read_only=True):
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/openstack/venvs/nova-17.0.5/lib/python2.7/site-packages/nova/virt/libvirt/storage/rbd_utils.py", line 71, in __init__
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     read_only=read_only))
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]   File "/usr/local/lib/python2.7/dist-packages/rbd.py", line 360, in __init__
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730]     raise TypeError('name must be a string')
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] TypeError: name must be a string
  2018-06-15 14:38:57.899 13411 ERROR nova.compute.manager [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] 
  2018-06-15 14:38:59.710 13411 INFO nova.compute.manager [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Terminating instance
  2018-06-15 14:38:59.729 13411 INFO nova.virt.libvirt.driver [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Instance destroyed successfully.
  2018-06-15 14:38:59.732 13411 INFO os_vif [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] Successfully unplugged vif VIFBridge(active=False,address=fa:16:3e:9a:6f:0e,bridge_name='brq1adccf1f-63',has_traffic_filtering=True,id=5ff5feac-cb04-46db-8580-0929efd4c6eb,network=Network(1adccf1f-639e-4c7a-8865-851893eeee9c),plugin='linux_bridge',port_profile=<?>,preserve_on_delete=False,vif_name='tap5ff5feac-cb')
  2018-06-15 14:38:59.815 13411 INFO nova.virt.libvirt.driver [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Deleting instance files /var/lib/nova/instances/bdd019bd-4127-4186-a1ee-f4b1891e1730_del
  2018-06-15 14:38:59.817 13411 INFO nova.virt.libvirt.driver [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Deletion of /var/lib/nova/instances/bdd019bd-4127-4186-a1ee-f4b1891e1730_del complete
  2018-06-15 14:38:59.922 13411 INFO nova.compute.manager [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Took 0.20 seconds to destroy the instance on the hypervisor.
  2018-06-15 14:39:00.773 13411 INFO nova.compute.manager [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] [instance: bdd019bd-4127-4186-a1ee-f4b1891e1730] Took 0.57 seconds to deallocate network for instance.
  2018-06-15 14:39:00.978 13411 INFO nova.scheduler.client.report [req-5726dc5e-06c9-40c3-8055-3a57e8ffd3a1 cdca526c2d674b51a209cf940688be7e 410ad59f6c5a4f27ba1bb5bf04bbb647 - default default] Deleted allocation for instance bdd019bd-4127-4186-a1ee-f4b1891e1730

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1777123/+subscriptions