yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1432288] [NEW] PortLimitExceeded

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: victorye81 <wan_cs@xxxxxxx>
Date: Sun, 15 Mar 2015 03:35:39 -0000
Reply-to: Bug 1432288 <1432288@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

I installed icehouse version，then create a new project, but when I
launch more than14 vms,the private network router interface status is
“build up” and the vm can not get the ip from DHCP pool.  dashborad
error is "Error: Failed to launch instance "vm-c1c3e0e9-6574-4c00-952c-
3b0ae42587a9": Please try again later [Error: No valid host was found.
Exceeded max scheduling attempts 3 for instance ef51fb3b-07be-4292-b35e-
404223b32abc]."

   I checked the compute node log of path /var/log/nova/compute，the
error record as follow：


[root@szxtscn08-ops ~]# tail -200  /var/log/nova/compute.log
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 407, in _sync_wrapper
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     self.wait()
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 439, in wait
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     self[:] = self._gt.wait()
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 173, in wait
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     return self._exit_event.wait()
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 125, in wait
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     current.throw(*self._exc)
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 212, in main
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     result = function(*args, **kwargs)
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1504, in _allocate_network_async
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     dhcp_options=dhcp_options)
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 360, in allocate_for_instance
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     LOG.exception(msg, port_id)
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     six.reraise(self.type_, self.value, self.tb)
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 335, in allocate_for_instance
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     security_group_ids, available_macs, dhcp_opts)
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 191, in _create_port
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     raise exception.PortLimitExceeded()
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] PortLimitExceeded: Maximum number of ports exceeded
2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] 
2015-03-13 11:42:03.913 63174 AUDIT nova.compute.manager [req-61198459-9f52-433e-bf02-54e65edd52d8 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Terminating instance
2015-03-13 11:42:03.917 63174 ERROR nova.virt.libvirt.driver [-] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] During wait destroy, instance disappeared.
2015-03-13 11:42:04.240 63174 INFO nova.virt.libvirt.driver [req-61198459-9f52-433e-bf02-54e65edd52d8 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Deleting instance files /var/lib/nova/instances/7ba7ea66-c6ba-416e-bec5-62e9f22154b1
2015-03-13 11:42:04.240 63174 INFO nova.virt.libvirt.driver [req-61198459-9f52-433e-bf02-54e65edd52d8 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Deletion of /var/lib/nova/instances/7ba7ea66-c6ba-416e-bec5-62e9f22154b1 complete
2015-03-13 11:42:04.572 63174 ERROR nova.compute.manager [req-61198459-9f52-433e-bf02-54e65edd52d8 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Error: Maximum number of ports exceeded
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Traceback (most recent call last):
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1305, in _build_instance
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     set_access_ip=set_access_ip)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 393, in decorated_function
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     return function(self, context, *args, **kwargs)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1717, in _spawn
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     LOG.exception(_('Instance failed to spawn'), instance=instance)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     six.reraise(self.type_, self.value, self.tb)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1714, in _spawn
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     block_device_info)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2258, in spawn
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     admin_pass=admin_password)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2709, in _create_image
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     instance, network_info, admin_pass, files, suffix)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2527, in _inject_data
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     net = netutils.get_injected_network_template(network_info)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 71, in get_injected_network_template
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     if not (network_info and template):
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 420, in __len__
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     return self._sync_wrapper(fn, *args, **kwargs)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 407, in _sync_wrapper
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     self.wait()
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 439, in wait
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     self[:] = self._gt.wait()
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 173, in wait
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     return self._exit_event.wait()
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 125, in wait
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     current.throw(*self._exc)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 212, in main
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     result = function(*args, **kwargs)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1504, in _allocate_network_async
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     dhcp_options=dhcp_options)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 360, in allocate_for_instance
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     LOG.exception(msg, port_id)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     six.reraise(self.type_, self.value, self.tb)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 335, in allocate_for_instance
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     security_group_ids, available_macs, dhcp_opts)
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 191, in _create_port
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     raise exception.PortLimitExceeded()
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] PortLimitExceeded: Maximum number of ports exceeded
2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] 
2015-03-13 11:42:05.482 63174 AUDIT nova.compute.manager [req-bd256dba-5a0b-4dc6-b13b-57d7def3f4c1 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Terminating instance
2015-03-13 11:42:05.486 63174 ERROR nova.virt.libvirt.driver [-] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] During wait destroy, instance disappeared.
2015-03-13 11:42:05.812 63174 INFO nova.virt.libvirt.driver [req-bd256dba-5a0b-4dc6-b13b-57d7def3f4c1 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Deletion of /var/lib/nova/instances/7ba7ea66-c6ba-416e-bec5-62e9f22154b1 complete
2015-03-13 11:42:06.882 63174 WARNING nova.virt.libvirt.driver [req-5b9af66c-23e3-4d41-9f74-404e971cc7f4 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] Timeout waiting for vif plugging callback for instance e732713a-f61b-4938-8950-ae8708843f76
2015-03-13 11:42:06.884 63174 INFO nova.compute.manager [-] Lifecycle event 3 on VM e732713a-f61b-4938-8950-ae8708843f76
2015-03-13 11:42:06.889 63174 INFO nova.virt.libvirt.driver [-] [instance: e732713a-f61b-4938-8950-ae8708843f76] Instance spawned successfully.
2015-03-13 11:42:07.168 63174 INFO nova.compute.manager [-] [instance: e732713a-f61b-4938-8950-ae8708843f76] During sync_power_state the instance has a pending task. Skip.
2015-03-13 11:42:07.169 63174 INFO nova.compute.manager [-] Lifecycle event 3 on VM e732713a-f61b-4938-8950-ae8708843f76
2015-03-13 11:42:08.292 63174 AUDIT nova.compute.manager [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Starting instance...
2015-03-13 11:42:08.304 63174 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
2015-03-13 11:42:09.093 63174 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 216807
2015-03-13 11:42:09.093 63174 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 2305
2015-03-13 11:42:09.093 63174 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 20
2015-03-13 11:42:09.191 63174 INFO nova.compute.resource_tracker [-] Compute_service record updated for szxtscn08-ops:szxtscn08-ops.huawei.com
2015-03-13 11:42:09.192 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Attempting claim: memory 4096 MB, disk 40 GB, VCPUs 2
2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Total memory: 258279 MB, used: 41472.00 MB
2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] memory limit: 387418.50 MB, free: 345946.50 MB
2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Total disk: 2745 GB, used: 440.00 GB
2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] disk limit not specified, defaulting to unlimited
2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Total CPUs: 40 VCPUs, used: 20.00 VCPUs
2015-03-13 11:42:09.194 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] CPUs limit not specified, defaulting to unlimited
2015-03-13 11:42:09.194 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Claim successful
2015-03-13 11:42:09.830 63174 WARNING nova.network.neutronv2.api [-] Neutron error: quota exceeded
2015-03-13 11:42:09.830 63174 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager Traceback (most recent call last):
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1504, in _allocate_network_async
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     dhcp_options=dhcp_options)
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 360, in allocate_for_instance
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     LOG.exception(msg, port_id)
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     six.reraise(self.type_, self.value, self.tb)
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 335, in allocate_for_instance
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     security_group_ids, available_macs, dhcp_opts)
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 191, in _create_port
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     raise exception.PortLimitExceeded()
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager PortLimitExceeded: Maximum number of ports exceeded
2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager 
2015-03-13 11:42:10.130 63174 INFO nova.virt.libvirt.driver [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Creating image
2015-03-13 11:42:10.171 63174 ERROR nova.compute.manager [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Instance failed to spawn

** Affects: neutron
     Importance: Undecided
         Status: New


** Tags: portlimitexceeded

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1432288

Title:
  PortLimitExceeded

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  I installed icehouse version，then create a new project, but when I
  launch more than14 vms,the private network router interface status is
  “build up” and the vm can not get the ip from DHCP pool.  dashborad
  error is "Error: Failed to launch instance "vm-c1c3e0e9-6574-4c00
  -952c-3b0ae42587a9": Please try again later [Error: No valid host was
  found. Exceeded max scheduling attempts 3 for instance ef51fb3b-
  07be-4292-b35e-404223b32abc]."

     I checked the compute node log of path /var/log/nova/compute，the
  error record as follow：

  
  [root@szxtscn08-ops ~]# tail -200  /var/log/nova/compute.log
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 407, in _sync_wrapper
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     self.wait()
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 439, in wait
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     self[:] = self._gt.wait()
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 173, in wait
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     return self._exit_event.wait()
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 125, in wait
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     current.throw(*self._exc)
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 212, in main
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     result = function(*args, **kwargs)
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1504, in _allocate_network_async
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     dhcp_options=dhcp_options)
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 360, in allocate_for_instance
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     LOG.exception(msg, port_id)
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     six.reraise(self.type_, self.value, self.tb)
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 335, in allocate_for_instance
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     security_group_ids, available_macs, dhcp_opts)
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 191, in _create_port
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     raise exception.PortLimitExceeded()
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] PortLimitExceeded: Maximum number of ports exceeded
  2015-03-13 11:42:03.727 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] 
  2015-03-13 11:42:03.913 63174 AUDIT nova.compute.manager [req-61198459-9f52-433e-bf02-54e65edd52d8 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Terminating instance
  2015-03-13 11:42:03.917 63174 ERROR nova.virt.libvirt.driver [-] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] During wait destroy, instance disappeared.
  2015-03-13 11:42:04.240 63174 INFO nova.virt.libvirt.driver [req-61198459-9f52-433e-bf02-54e65edd52d8 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Deleting instance files /var/lib/nova/instances/7ba7ea66-c6ba-416e-bec5-62e9f22154b1
  2015-03-13 11:42:04.240 63174 INFO nova.virt.libvirt.driver [req-61198459-9f52-433e-bf02-54e65edd52d8 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Deletion of /var/lib/nova/instances/7ba7ea66-c6ba-416e-bec5-62e9f22154b1 complete
  2015-03-13 11:42:04.572 63174 ERROR nova.compute.manager [req-61198459-9f52-433e-bf02-54e65edd52d8 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Error: Maximum number of ports exceeded
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Traceback (most recent call last):
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1305, in _build_instance
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     set_access_ip=set_access_ip)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 393, in decorated_function
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     return function(self, context, *args, **kwargs)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1717, in _spawn
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     LOG.exception(_('Instance failed to spawn'), instance=instance)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     six.reraise(self.type_, self.value, self.tb)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1714, in _spawn
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     block_device_info)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2258, in spawn
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     admin_pass=admin_password)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2709, in _create_image
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     instance, network_info, admin_pass, files, suffix)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2527, in _inject_data
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     net = netutils.get_injected_network_template(network_info)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/virt/netutils.py", line 71, in get_injected_network_template
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     if not (network_info and template):
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 420, in __len__
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     return self._sync_wrapper(fn, *args, **kwargs)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 407, in _sync_wrapper
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     self.wait()
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/model.py", line 439, in wait
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     self[:] = self._gt.wait()
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 173, in wait
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     return self._exit_event.wait()
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 125, in wait
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     current.throw(*self._exc)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 212, in main
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     result = function(*args, **kwargs)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1504, in _allocate_network_async
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     dhcp_options=dhcp_options)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 360, in allocate_for_instance
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     LOG.exception(msg, port_id)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     six.reraise(self.type_, self.value, self.tb)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 335, in allocate_for_instance
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     security_group_ids, available_macs, dhcp_opts)
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 191, in _create_port
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1]     raise exception.PortLimitExceeded()
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] PortLimitExceeded: Maximum number of ports exceeded
  2015-03-13 11:42:04.572 63174 TRACE nova.compute.manager [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] 
  2015-03-13 11:42:05.482 63174 AUDIT nova.compute.manager [req-bd256dba-5a0b-4dc6-b13b-57d7def3f4c1 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Terminating instance
  2015-03-13 11:42:05.486 63174 ERROR nova.virt.libvirt.driver [-] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] During wait destroy, instance disappeared.
  2015-03-13 11:42:05.812 63174 INFO nova.virt.libvirt.driver [req-bd256dba-5a0b-4dc6-b13b-57d7def3f4c1 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: 7ba7ea66-c6ba-416e-bec5-62e9f22154b1] Deletion of /var/lib/nova/instances/7ba7ea66-c6ba-416e-bec5-62e9f22154b1 complete
  2015-03-13 11:42:06.882 63174 WARNING nova.virt.libvirt.driver [req-5b9af66c-23e3-4d41-9f74-404e971cc7f4 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] Timeout waiting for vif plugging callback for instance e732713a-f61b-4938-8950-ae8708843f76
  2015-03-13 11:42:06.884 63174 INFO nova.compute.manager [-] Lifecycle event 3 on VM e732713a-f61b-4938-8950-ae8708843f76
  2015-03-13 11:42:06.889 63174 INFO nova.virt.libvirt.driver [-] [instance: e732713a-f61b-4938-8950-ae8708843f76] Instance spawned successfully.
  2015-03-13 11:42:07.168 63174 INFO nova.compute.manager [-] [instance: e732713a-f61b-4938-8950-ae8708843f76] During sync_power_state the instance has a pending task. Skip.
  2015-03-13 11:42:07.169 63174 INFO nova.compute.manager [-] Lifecycle event 3 on VM e732713a-f61b-4938-8950-ae8708843f76
  2015-03-13 11:42:08.292 63174 AUDIT nova.compute.manager [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Starting instance...
  2015-03-13 11:42:08.304 63174 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
  2015-03-13 11:42:09.093 63174 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 216807
  2015-03-13 11:42:09.093 63174 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 2305
  2015-03-13 11:42:09.093 63174 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 20
  2015-03-13 11:42:09.191 63174 INFO nova.compute.resource_tracker [-] Compute_service record updated for szxtscn08-ops:szxtscn08-ops.huawei.com
  2015-03-13 11:42:09.192 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Attempting claim: memory 4096 MB, disk 40 GB, VCPUs 2
  2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Total memory: 258279 MB, used: 41472.00 MB
  2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] memory limit: 387418.50 MB, free: 345946.50 MB
  2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Total disk: 2745 GB, used: 440.00 GB
  2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] disk limit not specified, defaulting to unlimited
  2015-03-13 11:42:09.193 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Total CPUs: 40 VCPUs, used: 20.00 VCPUs
  2015-03-13 11:42:09.194 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] CPUs limit not specified, defaulting to unlimited
  2015-03-13 11:42:09.194 63174 AUDIT nova.compute.claims [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Claim successful
  2015-03-13 11:42:09.830 63174 WARNING nova.network.neutronv2.api [-] Neutron error: quota exceeded
  2015-03-13 11:42:09.830 63174 ERROR nova.compute.manager [-] Instance failed network setup after 1 attempt(s)
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager Traceback (most recent call last):
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1504, in _allocate_network_async
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     dhcp_options=dhcp_options)
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 360, in allocate_for_instance
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     LOG.exception(msg, port_id)
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     six.reraise(self.type_, self.value, self.tb)
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 335, in allocate_for_instance
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     security_group_ids, available_macs, dhcp_opts)
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager   File "/usr/lib/python2.6/site-packages/nova/network/neutronv2/api.py", line 191, in _create_port
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager     raise exception.PortLimitExceeded()
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager PortLimitExceeded: Maximum number of ports exceeded
  2015-03-13 11:42:09.830 63174 TRACE nova.compute.manager 
  2015-03-13 11:42:10.130 63174 INFO nova.virt.libvirt.driver [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Creating image
  2015-03-13 11:42:10.171 63174 ERROR nova.compute.manager [req-e1bf2a93-c538-47e7-9456-ff6c7bd48b73 779cd9e64d3741a48f551e8e7f9f5028 e178db7e2c0f47edac41ac5522d5a486] [instance: ee30e643-2e97-4bf3-996a-cb7f408f601b] Instance failed to spawn

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1432288/+subscriptions
Follow ups

[Bug 1432288] Re: PortLimitExceeded
From: Sudipta Biswas, 2015-03-19
[Bug 1432288] [NEW] PortLimitExceeded
From: victorye81, 2015-03-15
References

[Bug 1432288] [NEW] PortLimitExceeded
From: victorye81, 2015-03-15