← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1353885] [NEW] L2Pop on OVS broken due to DeferredBridge introduction

 

Public bug reported:

The L2Pop feature seems to have broken due to OVS Concurrent DeferredBridge implementation approved here:
https://review.openstack.org/77578

On the OVS Agent logs on compute hosts, could see that dynamic
add_tunnel_port creation is failing:

2014-08-07 01:05:37.618 ^[[01;31mERROR oslo.messaging.rpc.dispatcher [^[[01;36mreq-0561d1e7-87a9-43cf-b7d4-c60e560d34f5 ^[[00;36mNone None^[[01;31m] ^[[01;35m^[[01;31mException during message handling: add_tunnel_port^[[00m
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00mTraceback (most recent call last):
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    incoming.message))
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    return self._do_dispatch(endpoint, method, ctxt, args)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    result = getattr(endpoint, method)(ctxt, **new_args)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/common/log.py", line 36, in wrapper
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    return method(*args, **kwargs)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/agent/l2population_rpc.py", line 45, in add_fdb_entries
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    self.fdb_add(context, fdb_entries)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 347, in fdb_add
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    agent_ports, self.tun_br_ofports)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/common/log.py", line 36, in wrapper
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    return method(*args, **kwargs)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/agent/l2population_rpc.py", line 179, in fdb_add_tun
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    lvm.network_type)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1061, in setup_tunnel_port
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    network_type)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1017, in _setup_tunnel_port
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    ofport = br.add_tunnel_port(port_name,
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/agent/linux/ovs_lib.py", line 486, in __getattr__
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    raise AttributeError(name)
^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00mAttributeError: add_tunnel_port

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1353885

Title:
  L2Pop on OVS broken due to DeferredBridge introduction

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  The L2Pop feature seems to have broken due to OVS Concurrent DeferredBridge implementation approved here:
  https://review.openstack.org/77578

  On the OVS Agent logs on compute hosts, could see that dynamic
  add_tunnel_port creation is failing:

  2014-08-07 01:05:37.618 ^[[01;31mERROR oslo.messaging.rpc.dispatcher [^[[01;36mreq-0561d1e7-87a9-43cf-b7d4-c60e560d34f5 ^[[00;36mNone None^[[01;31m] ^[[01;35m^[[01;31mException during message handling: add_tunnel_port^[[00m
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00mTraceback (most recent call last):
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 134, in _dispatch_and_reply
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    incoming.message))
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 177, in _dispatch
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    return self._do_dispatch(endpoint, method, ctxt, args)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 123, in _do_dispatch
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    result = getattr(endpoint, method)(ctxt, **new_args)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/common/log.py", line 36, in wrapper
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    return method(*args, **kwargs)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/agent/l2population_rpc.py", line 45, in add_fdb_entries
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    self.fdb_add(context, fdb_entries)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 347, in fdb_add
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    agent_ports, self.tun_br_ofports)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/common/log.py", line 36, in wrapper
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    return method(*args, **kwargs)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/agent/l2population_rpc.py", line 179, in fdb_add_tun
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    lvm.network_type)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1061, in setup_tunnel_port
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    network_type)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1017, in _setup_tunnel_port
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    ofport = br.add_tunnel_port(port_name,
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m  File "/opt/stack/neutron/neutron/agent/linux/ovs_lib.py", line 486, in __getattr__
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00m    raise AttributeError(name)
  ^[[01;31m2014-08-07 01:05:37.618 TRACE oslo.messaging.rpc.dispatcher ^[[01;35m^[[00mAttributeError: add_tunnel_port

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1353885/+subscriptions


Follow ups

References