← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #23973

[Bug 1384109] [NEW] Mechanism driver 'l2population' failed in update_port_postcommit

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

OpenStack Juno, Ubuntu 14.04, 3 x neutron-server's with 32 API workers
each, rally/boot-and-delete with a concurrency level of 150:

2014-10-21 16:37:04.615 16312 ERROR neutron.plugins.ml2.managers [req-c4cdefd5-b2d9-46fa-a031-bddd03d981e6 None] Mechanism driver 'l2population' failed in update_port_postcommit
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 291, in _call_on_drivers
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers     getattr(driver.obj, method_name)(context)
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 135, in update_port_postcommit
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers     self._update_port_up(context)
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 228, in _update_port_up
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers     agent_ports += self._get_port_fdb_entries(binding.port)
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 45, in _get_port_fdb_entries
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers     ip['ip_address']] for ip in port['fixed_ips']]
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers TypeError: 'NoneType' object has no attribute '__getitem__'
2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers
2014-10-21 16:37:04.618 16312 ERROR oslo.messaging.rpc.dispatcher [req-c4cdefd5-b2d9-46fa-a031-bddd03d981e6 ] Exception during message handling: update_port_postcommit failed.
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/rpc.py", line 161, in update_device_up
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     host)
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/plugin.py", line 1136, in update_port_status
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     self.mechanism_manager.update_port_postcommit(mech_context)
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 527, in update_port_postcommit
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     continue_on_failure=True)
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 302, in _call_on_drivers
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     method=method_name
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher MechanismDriverError: update_port_postcommit failed.
2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher
2014-10-21 16:37:04.620 16312 ERROR oslo.messaging._drivers.common [req-c4cdefd5-b2d9-46fa-a031-bddd03d981e6 ] Returning exception update_port_postcommit failed. to caller
2014-10-21 16:37:04.621 16312 ERROR oslo.messaging._drivers.common [req-c4cdefd5-b2d9-46fa-a031-bddd03d981e6 ] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch\n    result = getattr(endpoint, method)(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/rpc.py", line 161, in update_device_up\n    host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/plugin.py", line 1136, in update_port_status\n    self.mechanism_manager.update_port_postcommit(mech_context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 527, in update_port_postcommit\n    continue_on_failure=True)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 302, in _call_on_drivers\n    method=method_name\n', 'MechanismDriverError: update_port_postcommit failed.\n']

** Affects: neutron
     Importance: Undecided
         Status: New

** Affects: neutron (Ubuntu)
     Importance: Undecided
         Status: New


** Tags: juno scale-testing

** Tags added: juno scale-testing

** Also affects: neutron (Ubuntu)
   Importance: Undecided
       Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1384109

Title:
  Mechanism driver 'l2population' failed in update_port_postcommit

Status in OpenStack Neutron (virtual network service):
  New
Status in “neutron” package in Ubuntu:
  New

Bug description:
  OpenStack Juno, Ubuntu 14.04, 3 x neutron-server's with 32 API workers
  each, rally/boot-and-delete with a concurrency level of 150:

  2014-10-21 16:37:04.615 16312 ERROR neutron.plugins.ml2.managers [req-c4cdefd5-b2d9-46fa-a031-bddd03d981e6 None] Mechanism driver 'l2population' failed in update_port_postcommit
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers Traceback (most recent call last):
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 291, in _call_on_drivers
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers     getattr(driver.obj, method_name)(context)
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 135, in update_port_postcommit
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers     self._update_port_up(context)
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 228, in _update_port_up
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers     agent_ports += self._get_port_fdb_entries(binding.port)
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 45, in _get_port_fdb_entries
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers     ip['ip_address']] for ip in port['fixed_ips']]
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers TypeError: 'NoneType' object has no attribute '__getitem__'
  2014-10-21 16:37:04.615 16312 TRACE neutron.plugins.ml2.managers
  2014-10-21 16:37:04.618 16312 ERROR oslo.messaging.rpc.dispatcher [req-c4cdefd5-b2d9-46fa-a031-bddd03d981e6 ] Exception during message handling: update_port_postcommit failed.
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/rpc.py", line 161, in update_device_up
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     host)
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/plugin.py", line 1136, in update_port_status
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     self.mechanism_manager.update_port_postcommit(mech_context)
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 527, in update_port_postcommit
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     continue_on_failure=True)
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 302, in _call_on_drivers
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher     method=method_name
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher MechanismDriverError: update_port_postcommit failed.
  2014-10-21 16:37:04.618 16312 TRACE oslo.messaging.rpc.dispatcher
  2014-10-21 16:37:04.620 16312 ERROR oslo.messaging._drivers.common [req-c4cdefd5-b2d9-46fa-a031-bddd03d981e6 ] Returning exception update_port_postcommit failed. to caller
  2014-10-21 16:37:04.621 16312 ERROR oslo.messaging._drivers.common [req-c4cdefd5-b2d9-46fa-a031-bddd03d981e6 ] ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply\n    incoming.message))\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch\n    return self._do_dispatch(endpoint, method, ctxt, args)\n', '  File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch\n    result = getattr(endpoint, method)(ctxt, **new_args)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/rpc.py", line 161, in update_device_up\n    host)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/plugin.py", line 1136, in update_port_status\n    self.mechanism_manager.update_port_postcommit(mech_context)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 527, in update_port_postcommit\n    continue_on_failure=True)\n', '  File "/usr/lib/python2.7/dist-packages/neutron/plugins/ml2/managers.py", line 302, in _call_on_drivers\n    method=method_name\n', 'MechanismDriverError: update_port_postcommit failed.\n']

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1384109/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next