yahoo-eng-team team mailing list archive

Thread
Date
[Bug 2115411] [NEW] [ovn-octavia-provider] Exception observe when there no IP available for VIP

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Nilesh <2115411@xxxxxxxxxxxxxxxxxx>
Date: Thu, 26 Jun 2025 10:00:57 -0000
Reply-to: Bug 2115411 <2115411@xxxxxxxxxxxxxxxxxx>
Sender: noreply@xxxxxxxxxxxxx
Public bug reported:

The request to create a load balancer is erroring out because there are
no available IPs in the network pool that it is using. However, OVN
provider driver is not handling this error correctly and ends up
throwing a 500 error response, when it should just be relaying the 409
that neutron threw above.

This masks the issue and let’s the user think that the service is
misbehaving while in fact, they need to go back and free up some IP
addresses.

2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils [None req-62861c3a-b121-4a6e-bebf-5bdebab8c92f - 295e90a1551944e084cde387330c6da0 - - default defaul
t] Provider 'ovn' raised a driver error: No more IP addresses available on network f01b49aa-37fa-4335-880f-d1ace1ba287c.: octavia_lib.api.drivers.exceptions.Drive
rError: No more IP addresses available on network f01b49aa-37fa-4335-880f-d1ace1ba287c.
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils Traceback (most recent call last):
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/driver.py", line 497, i
n create_vip_port
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     port, additional_ports = self._ovn_helper.create_vip_port(
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/helper.py", line 2359,
in create_vip_port
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     raise e
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/helper.py", line 2328,
in create_vip_port
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     vip_port = self._create_neutron_port(
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/helper.py", line 2316,
in _create_neutron_port
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     raise e
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/helper.py", line 2305,
in _create_neutron_port
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     return neutron_client.create_port(**port)
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/network/v2/_proxy.py", line 2892,
in create_port
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     return self._create(_port.Port, **attrs)
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/proxy.py", line 643, in _create
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     return res.create(self, base_path=base_path)
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/resource.py", line 1533, in create
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     self._translate_response(response, **response_kwargs)
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/resource.py", line 1285, in _trans
late_response
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     exceptions.raise_from_response(response, error_message=error_message)
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/exceptions.py", line 244, in raise
_from_response
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     raise cls(
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils openstack.exceptions.ConflictException: ConflictException: 409: Client Error for url: http://neutron
-server.testbed.svc.cluster.local:9696/v2.0/ports, No more IP addresses available on network f01b49aa-37fa-4335-880f-d1ace1ba287c.
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils During handling of the above exception, another exception occurred:
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils Traceback (most recent call last):
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/octavia/api/drivers/utils.py", line 52, in c
all_provider
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     return driver_method(*args, **kwargs)
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/driver.py", line 521, i
n create_vip_port
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     raise driver_exceptions.DriverError(
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils octavia_lib.api.drivers.exceptions.DriverError: No more IP addresses available on network f01b49aa-3
7fa-4335-880f-d1ace1ba287c.
2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils
10.144.201.135 - - [15/Jun/2025 11:41:44] "POST /v2.0/lbaas/loadbalancers HTTP/1.1" 500 170

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2115411

Title:
  [ovn-octavia-provider]  Exception observe when there no IP available
  for VIP

Status in neutron:
  New

Bug description:
  The request to create a load balancer is erroring out because there
  are no available IPs in the network pool that it is using. However,
  OVN provider driver is not handling this error correctly and ends up
  throwing a 500 error response, when it should just be relaying the 409
  that neutron threw above.

  This masks the issue and let’s the user think that the service is
  misbehaving while in fact, they need to go back and free up some IP
  addresses.

  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils [None req-62861c3a-b121-4a6e-bebf-5bdebab8c92f - 295e90a1551944e084cde387330c6da0 - - default defaul
  t] Provider 'ovn' raised a driver error: No more IP addresses available on network f01b49aa-37fa-4335-880f-d1ace1ba287c.: octavia_lib.api.drivers.exceptions.Drive
  rError: No more IP addresses available on network f01b49aa-37fa-4335-880f-d1ace1ba287c.
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils Traceback (most recent call last):
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/driver.py", line 497, i
  n create_vip_port
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     port, additional_ports = self._ovn_helper.create_vip_port(
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/helper.py", line 2359,
  in create_vip_port
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     raise e
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/helper.py", line 2328,
  in create_vip_port
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     vip_port = self._create_neutron_port(
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/helper.py", line 2316,
  in _create_neutron_port
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     raise e
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/helper.py", line 2305,
  in _create_neutron_port
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     return neutron_client.create_port(**port)
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/network/v2/_proxy.py", line 2892,
  in create_port
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     return self._create(_port.Port, **attrs)
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/proxy.py", line 643, in _create
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     return res.create(self, base_path=base_path)
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/resource.py", line 1533, in create
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     self._translate_response(response, **response_kwargs)
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/resource.py", line 1285, in _trans
  late_response
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     exceptions.raise_from_response(response, error_message=error_message)
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/openstack/exceptions.py", line 244, in raise
  _from_response
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     raise cls(
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils openstack.exceptions.ConflictException: ConflictException: 409: Client Error for url: http://neutron
  -server.testbed.svc.cluster.local:9696/v2.0/ports, No more IP addresses available on network f01b49aa-37fa-4335-880f-d1ace1ba287c.
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils During handling of the above exception, another exception occurred:
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils Traceback (most recent call last):
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/octavia/api/drivers/utils.py", line 52, in c
  all_provider
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     return driver_method(*args, **kwargs)
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils   File "/var/lib/openstack/lib/python3.10/site-packages/ovn_octavia_provider/driver.py", line 521, i
  n create_vip_port
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils     raise driver_exceptions.DriverError(
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils octavia_lib.api.drivers.exceptions.DriverError: No more IP addresses available on network f01b49aa-3
  7fa-4335-880f-d1ace1ba287c.
  2025-06-15 11:41:44,382.382 1 ERROR octavia.api.drivers.utils
  10.144.201.135 - - [15/Jun/2025 11:41:44] "POST /v2.0/lbaas/loadbalancers HTTP/1.1" 500 170

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2115411/+subscriptions