← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1610303] Re: l2pop mech fails to update_port_postcommit on a loaded cluster

 

Reviewed:  https://review.openstack.org/352844
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=26bdffb3d73f12833f6fdbdfab6f584f84507693
Submitter: Jenkins
Branch:    master

commit 26bdffb3d73f12833f6fdbdfab6f584f84507693
Author: Oleg Bondarev <obondarev@xxxxxxxxxxxx>
Date:   Tue Aug 9 13:45:26 2016 +0300

    Handle deleted ports when creating a list of fdb entries
    
    The issue might happen when VMs are intensively created/deleted.
    With the patch deleted ports will be just skipped.
    
    Closes-Bug: #1610303
    Change-Id: I32b0de9c452cf973d687c72e8381584012c9f3b4


** Changed in: neutron
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1610303

Title:
  l2pop mech fails to update_port_postcommit on a loaded cluster

Status in neutron:
  Fix Released

Bug description:
  On a cluster where VMs boots and deletes happen pretty intensively
  following traces can pop up in neutron server log:

  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers [req-1b5e9a29-7f7e-48f8-84ee-19ce217cb556 - - - - -] Mechanism driver 'l2population' failed in update_port_postcommit
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers Traceback (most recent call last):
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 401, in _call_on_drivers
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers     getattr(driver.obj, method_name)(context)
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 120, in update_port_postcommit
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers     self._update_port_up(context)
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 227, in _update_port_up
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers     network_id)
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 176, in _create_agent_fdb
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers     fdbs.extend(self._get_port_fdb_entries(binding.port))
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 45, in _get_port_fdb_entries
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers     for ip in port['fixed_ips']]
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers TypeError: 'NoneType' object has no attribute '__getitem__'
  2016-08-05 14:08:29.575 9560 ERROR neutron.plugins.ml2.managers
  2016-08-05 14:08:29.578 9560 ERROR neutron.plugins.ml2.rpc [req-1b5e9a29-7f7e-48f8-84ee-19ce217cb556 - - - - -] Failed to update device 4c499a14-7211-4714-afa2-95b280d595a2 up

  This leads to device to being set to Active state and hence Nova
  timeouts waiting for the interface to be ready.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1610303/+subscriptions


References