yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1210424] Re: "No more IP addresses available on network"

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Armando Migliaccio <1210424@xxxxxxxxxxxxxxxxxx>
Date: Wed, 20 Nov 2013 19:50:30 -0000
Reply-to: Bug 1210424 <1210424@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
*** This bug is a duplicate of bug 1232971 ***
    https://bugs.launchpad.net/bugs/1232971

** This bug has been marked a duplicate of bug 1232971
   tempest gating error: test_run_stop_terminate_instance_with_tags

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1210424

Title:
  "No more IP addresses available on network"

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  From this failed run: http://logs.openstack.org/05/40205/1/check/gate-
  tempest-devstack-vm-neutron-full/b7ae92a/

  Related exceptions found in http://logs.openstack.org/05/40205/1/check
  /gate-tempest-devstack-vm-neutron-
  full/b7ae92a/logs/screen-n-api.txt.gz:

  
  REQ: curl -i http://127.0.0.1:9696/v2.0/floatingips.json -X POST -H "X-Auth-Token: @@@@@@@" -H "Content-Type: application/json" -H "Accept: application/json" -H "User-Agent: python-neutronclient" -d '{"floatingip": {"floating_network_id": "e19241fd-bd74-4604-9f0b-49d367c3d4d6"}}'
   http_log_req /opt/stack/new/python-neutronclient/neutronclient/common/utils.py:173
  2013-08-05 12:09:50.657 26450 DEBUG neutronclient.client [-] RESP:{'date': 'Mon, 05 Aug 2013 12:09:50 GMT', 'status': '409', 'content-length': '99', 'content-type': 'application/json; charset=UTF-8'} {"NeutronError": "No more IP addresses available on network e19241fd-bd74-4604-9f0b-49d367c3d4d6."}
   http_log_resp /opt/stack/new/python-neutronclient/neutronclient/common/utils.py:179
  2013-08-05 12:09:50.658 26450 DEBUG neutronclient.v2_0.client [-] Error message: {"NeutronError": "No more IP addresses available on network e19241fd-bd74-4604-9f0b-49d367c3d4d6."} _handle_fault_response /opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py:756
  2013-08-05 12:09:50.658 ERROR nova.api.openstack [req-e9996933-33ae-4587-b329-5316fd289780 demo demo] Caught error: No more IP addresses available on network e19241fd-bd74-4604-9f0b-49d367c3d4d6.
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack Traceback (most recent call last):
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/nova/nova/api/openstack/__init__.py", line 111, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return req.get_response(self.application)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/webob/request.py", line 1296, in send
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     application, catch_exc_info=False)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/webob/request.py", line 1260, in call_application
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     app_iter = application(self.environ, start_response)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return resp(environ, start_response)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/python-keystoneclient/keystoneclient/middleware/auth_token.py", line 473, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return self.app(env, start_response)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return resp(environ, start_response)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return resp(environ, start_response)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/routes/middleware.py", line 131, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     response = self.app(environ, start_response)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return resp(environ, start_response)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     resp = self.call_func(req, *args, **self.kwargs)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/usr/local/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return self.func(req, *args, **kwargs)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/nova/nova/api/openstack/wsgi.py", line 904, in __call__
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     content_type, body, accept)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/nova/nova/api/openstack/wsgi.py", line 963, in _process_stack
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     action_result = self.dispatch(meth, request, action_args)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/nova/nova/api/openstack/wsgi.py", line 1044, in dispatch
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return method(req=request, **action_args)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/nova/nova/api/openstack/compute/contrib/floating_ips.py", line 159, in create
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     address = self.network_api.allocate_floating_ip(context, pool)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/nova/nova/network/neutronv2/api.py", line 776, in allocate_floating_ip
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     fip = client.create_floatingip(param)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 108, in with_params
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     ret = self.function(instance, *args, **kwargs)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 407, in create_floatingip
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     return self.post(self.floatingips_path, body=body)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 872, in post
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     headers=headers, params=params)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 795, in do_request
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     self._handle_fault_response(status_code, replybody)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 765, in _handle_fault_response
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     exception_handler_v20(status_code, des_error_body)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack   File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 81, in exception_handler_v20
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack     message=error_dict)
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack NeutronClientException: No more IP addresses available on network e19241fd-bd74-4604-9f0b-49d367c3d4d6.
  2013-08-05 12:09:50.658 26450 TRACE nova.api.openstack 
  2013-08-05 12:09:50.659 INFO nova.api.openstack [req-e9996933-33ae-4587-b329-5316fd289780 demo demo] http://127.0.0.1:8774/v2/94a69b65117b46ea88dbac6e5fc4978a/os-floating-ips returned with HTTP 500
  2013-08-05 12:09:50.660 DEBUG nova.api.openstack.wsgi [req-e9996933-33ae-4587-b329-5316fd289780 demo demo] Returning 500 to user: The server has either erred or is incapable of performing the requested operation. __call__ /opt/stack/new/nova/nova/api/openstack/wsgi.py:1188
  2013-08-05 12:09:50.661 INFO nova.osapi_compute.wsgi.server [req-e9996933-33ae-4587-b329-5316fd289780 demo demo] 127.0.0.1 "POST /v2/94a69b65117b46ea88dbac6e5fc4978a/os-floating-ips HTTP/1.1" status: 500 len: 398 time: 0.0532880

  
  And in http://logs.openstack.org/05/40205/1/check/gate-tempest-devstack-vm-neutron-full/b7ae92a/logs/screen-q-svc.txt.gz:

  
  2013-08-05 12:09:50.655 26473 ERROR neutron.api.v2.resource [-] create failed
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource Traceback (most recent call last):
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 82, in resource
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource     result = method(request=request, **args)
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 403, in create
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource     obj = obj_creator(request.context, **kwargs)
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 648, in create_floatingip
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource     'name': ''}})
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/plugins/openvswitch/ovs_neutron_plugin.py", line 539, in create_port
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource     port = super(OVSNeutronPluginV2, self).create_port(context, port)
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1341, in create_port
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource     ips = self._allocate_ips_for_port(context, network, port)
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 735, in _allocate_ips_for_port
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource     result = NeutronDbPluginV2._generate_ip(context, subnets)
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 498, in _generate_ip
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource     raise q_exc.IpAddressGenerationFailure(net_id=subnets[0]['network_id'])
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource IpAddressGenerationFailure: No more IP addresses available on network e19241fd-bd74-4604-9f0b-49d367c3d4d6.
  2013-08-05 12:09:50.655 26473 TRACE neutron.api.v2.resource

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1210424/+subscriptions