yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #42796
[Bug 1515768] Re: Instance creation fails with libvirtError: Unable to create tap device: Device or resource busy
>From the analysis above I gather there's not much that can be done from
the Neutron-side, especially if the failure mode is caused by the
specific use case mentioned.
** No longer affects: neutron
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1515768
Title:
Instance creation fails with libvirtError: Unable to create tap
device: Device or resource busy
Status in heat:
New
Status in OpenStack Compute (nova):
In Progress
Status in tacker:
In Progress
Bug description:
Summary:
This issue is observed frequently on Jenkins gate and has been reproducible in local setup too.
Steps:
Initiate 3 stack create requests at once in a script:
heat stack-create -f /home/stack/template_file stack1
heat stack-create -f /home/stack/template_file stack2
heat stack-create -f /home/stack/template_file stack3
using the following HOT file:
http://paste.openstack.org/show/479920/
One of the stack creations fails with CreateFailed: Resource Create Failed: Conflict: Resources. vdu3: Port Is Still In Use.
From the nova logs, there are duplicate bridges created for one of the
servers. The qemu xml fails with libvirtError: Unable to create tap
device tapd3a3d9e9-5d: Device or resource busy. See timestamp
2015-11-25 23:03:14.940 in n-cpu.log
Attaching the relevant n-cpu.log, q-svc.log and h-eng.log
Observation:
The 1st network interface for the nova instance is a Neutron Port resource provided in HOT template.
Nova sends a PUT request to update the port information. It also sends 2 POST requests for the 2nd and 3rd network interfaces.
Neutron receives the PUT request and sends network-event changed event while nova is still waiting for the POST response for the 2 ports.
If the network-changed event is received before the 3rd port POST response is received, refresh_cache is acquired by nova_service
Nova sends a query for port information, updates the cache and release the lock.
By then, POST requests are completed which acquires the cache lock again and sends request for network info. refresh_cache is updated twice and contains duplicate set of ports
Network vifs are built for all 6 ports and qemu xml is build based on that.
Duplicate bridges in xml is complained by libvirt as device or resource busy.
Version and environment:
Devstack Master
To manage notifications about this bug go to:
https://bugs.launchpad.net/heat/+bug/1515768/+subscriptions
References