← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1834257] [NEW] dhcp-agent can overwhelm neutron server with dhcp_ready_on_ports RPC calls

 

Public bug reported:

The Neutron dhcp-agents reports all ready ports to the Neutron server
via the dhcp_ready_on_ports() RPC call. When the dhcp-agent gets ports
ready faster than the server can process them, the amount of ports per
RPC call can grow so high (e.g. 10000 Ports) that the neutron server
never has a chance of processing the request before the RPC timeout
kills the request, leading to the dhcp-agent sending the request again,
possibly with even more ports than before, resulting in an endless loop
of dhcp_ready_on_ports() calls. This happens especially on agent
startup.

We should use either a smaller fixed amount, or use an algorithm to
reduce the number being sent in the event a message timeout is received.

** Affects: neutron
     Importance: High
     Assignee: Brian Haley (brian-haley)
         Status: In Progress


** Tags: l3-ipam-dhcp

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1834257

Title:
  dhcp-agent can overwhelm neutron server with dhcp_ready_on_ports RPC
  calls

Status in neutron:
  In Progress

Bug description:
  The Neutron dhcp-agents reports all ready ports to the Neutron server
  via the dhcp_ready_on_ports() RPC call. When the dhcp-agent gets ports
  ready faster than the server can process them, the amount of ports per
  RPC call can grow so high (e.g. 10000 Ports) that the neutron server
  never has a chance of processing the request before the RPC timeout
  kills the request, leading to the dhcp-agent sending the request
  again, possibly with even more ports than before, resulting in an
  endless loop of dhcp_ready_on_ports() calls. This happens especially
  on agent startup.

  We should use either a smaller fixed amount, or use an algorithm to
  reduce the number being sent in the event a message timeout is
  received.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1834257/+subscriptions


Follow ups