yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1379533] [NEW] Launching a server with an ip that is already in use leads to 500

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Vish Ishaya <vishvananda@xxxxxxxxx>
Date: Thu, 09 Oct 2014 21:27:04 -0000
Reply-to: Bug 1379533 <1379533@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Example:
nova boot --flavor m1.tiny --image CirrOS foo --nic net-id=eec0279f-7c6d-4548-9fa4-32823854819b,v4-fixed-ip=10.1.0.2
# wait for boot
nova boot --flavor m1.tiny --image CirrOS foo --nic net-id=eec0279f-7c6d-4548-9fa4-32823854819b,v4-fixed-ip=10.1.0.2
ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-54d1bf40-d113-4bb6-a8f9-079dff90a750)

logs:

2014-10-09 21:19:13.806 12252 ERROR nova.api.openstack [req-9a34deb0-9716-4f2a-85ef-309d56987708 dc7d1b517608484e8a0ede6787d9f5cb cac8e782ab39473bb42955b6847bc647] Caught error: Fixed IP address 10.1.0.2 is already in use on instance 55321ca2-f599-484a-ac65-208dc4b789e8.
Traceback (most recent call last):

  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
    incoming.message))

  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
    return self._do_dispatch(endpoint, method, ctxt, args)

  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
    result = getattr(endpoint, method)(ctxt, **new_args)

  File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1436, in validate_networks
    instance_uuid=fixed_ip_ref.instance_uuid)

FixedIpAlreadyInUse: Fixed IP address 10.1.0.2 is already in use on instance 55321ca2-f599-484a-ac65-208dc4b789e8.
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack Traceback (most recent call last):
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/__init__.py", line 125, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return req.get_response(self.application)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1296, in send
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     application, catch_exc_info=False)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1260, in call_application
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     app_iter = application(self.environ, start_response)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return resp(environ, start_response)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/keystoneclient/middleware/auth_token.py", line 588, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self.app(env, start_response)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return resp(environ, start_response)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return resp(environ, start_response)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/routes/middleware.py", line 131, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     response = self.app(environ, start_response)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return resp(environ, start_response)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     resp = self.call_func(req, *args, **self.kwargs)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self.func(req, *args, **kwargs)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 917, in __call__
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     content_type, body, accept)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 983, in _process_stack
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     action_result = self.dispatch(meth, request, action_args)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 1070, in dispatch
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return method(req=request, **action_args)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 956, in create
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     legacy_bdm=legacy_bdm)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/hooks.py", line 103, in inner
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     rv = f(*args, **kwargs)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 1342, in create
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     legacy_bdm=legacy_bdm)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 969, in _create_instance
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     max_count)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 740, in _validate_and_build_base_options
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     requested_networks, max_count)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 464, in _check_requested_networks
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     max_count)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 96, in wrapped
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return func(self, context, *args, **kwargs)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 515, in validate_networks
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     requested_networks)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 225, in validate_networks
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self.client.call(ctxt, 'validate_networks', networks=networks)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 361, in call
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self.prepare().call(ctxt, method, **kwargs)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     wait_for_reply=True, timeout=timeout)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     timeout=timeout)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self._send(target, ctxt, message, wait_for_reply, timeout)
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 405, in _send
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     raise result
2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack FixedIpAlreadyInUse_Remote: Fixed IP address 10.1.0.2 is already in use on instance 55321ca2-f599-484a-ac65-208dc4b789e8.

** Affects: nova
     Importance: Undecided
     Assignee: Vish Ishaya (vishvananda)
         Status: In Progress

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1379533

Title:
  Launching a server with an ip that is already in use leads to 500

Status in OpenStack Compute (Nova):
  In Progress

Bug description:
  Example:
  nova boot --flavor m1.tiny --image CirrOS foo --nic net-id=eec0279f-7c6d-4548-9fa4-32823854819b,v4-fixed-ip=10.1.0.2
  # wait for boot
  nova boot --flavor m1.tiny --image CirrOS foo --nic net-id=eec0279f-7c6d-4548-9fa4-32823854819b,v4-fixed-ip=10.1.0.2
  ERROR: The server has either erred or is incapable of performing the requested operation. (HTTP 500) (Request-ID: req-54d1bf40-d113-4bb6-a8f9-079dff90a750)

  logs:

  2014-10-09 21:19:13.806 12252 ERROR nova.api.openstack [req-9a34deb0-9716-4f2a-85ef-309d56987708 dc7d1b517608484e8a0ede6787d9f5cb cac8e782ab39473bb42955b6847bc647] Caught error: Fixed IP address 10.1.0.2 is already in use on instance 55321ca2-f599-484a-ac65-208dc4b789e8.
  Traceback (most recent call last):

    File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 133, in _dispatch_and_reply
      incoming.message))

    File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 176, in _dispatch
      return self._do_dispatch(endpoint, method, ctxt, args)

    File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 122, in _do_dispatch
      result = getattr(endpoint, method)(ctxt, **new_args)

    File "/usr/lib/python2.7/dist-packages/nova/network/manager.py", line 1436, in validate_networks
      instance_uuid=fixed_ip_ref.instance_uuid)

  FixedIpAlreadyInUse: Fixed IP address 10.1.0.2 is already in use on instance 55321ca2-f599-484a-ac65-208dc4b789e8.
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack Traceback (most recent call last):
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/__init__.py", line 125, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return req.get_response(self.application)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1296, in send
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     application, catch_exc_info=False)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/request.py", line 1260, in call_application
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     app_iter = application(self.environ, start_response)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return resp(environ, start_response)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/keystoneclient/middleware/auth_token.py", line 588, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self.app(env, start_response)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return resp(environ, start_response)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return resp(environ, start_response)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/routes/middleware.py", line 131, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     response = self.app(environ, start_response)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 144, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return resp(environ, start_response)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 130, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     resp = self.call_func(req, *args, **self.kwargs)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/webob/dec.py", line 195, in call_func
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self.func(req, *args, **kwargs)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 917, in __call__
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     content_type, body, accept)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 983, in _process_stack
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     action_result = self.dispatch(meth, request, action_args)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/wsgi.py", line 1070, in dispatch
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return method(req=request, **action_args)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/api/openstack/compute/servers.py", line 956, in create
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     legacy_bdm=legacy_bdm)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/hooks.py", line 103, in inner
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     rv = f(*args, **kwargs)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 1342, in create
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     legacy_bdm=legacy_bdm)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 969, in _create_instance
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     max_count)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 740, in _validate_and_build_base_options
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     requested_networks, max_count)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/compute/api.py", line 464, in _check_requested_networks
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     max_count)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 96, in wrapped
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return func(self, context, *args, **kwargs)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/api.py", line 515, in validate_networks
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     requested_networks)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/nova/network/rpcapi.py", line 225, in validate_networks
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self.client.call(ctxt, 'validate_networks', networks=networks)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 361, in call
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self.prepare().call(ctxt, method, **kwargs)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     wait_for_reply=True, timeout=timeout)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 90, in _send
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     timeout=timeout)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 412, in send
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     return self._send(target, ctxt, message, wait_for_reply, timeout)
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack   File "/usr/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 405, in _send
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack     raise result
  2014-10-09 21:19:13.806 12252 TRACE nova.api.openstack FixedIpAlreadyInUse_Remote: Fixed IP address 10.1.0.2 is already in use on instance 55321ca2-f599-484a-ac65-208dc4b789e8.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1379533/+subscriptions
Follow ups

[Bug 1379533] Re: Launching a server with an ip that is already in use leads to 500
From: Vish Ishaya, 2014-10-13
[Bug 1379533] [NEW] Launching a server with an ip that is already in use leads to 500
From: Vish Ishaya, 2014-10-09
References

[Bug 1379533] [NEW] Launching a server with an ip that is already in use leads to 500
From: Vish Ishaya, 2014-10-09