yahoo-eng-team team mailing list archive

[Thierry Carrez <thierry.carrez+lp@xxxxxxxxx>]

** Changed in: neutron
       Status: Fix Committed => Fix Released

** Changed in: neutron
    Milestone: None => liberty-rc1

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1455338

Title:
  OVS-agent: KeyError for local_vlan_map

Status in neutron:
  Fix Released

Bug description:
  OVS-agent's network_delete calls reclaim_local_vlan, which removes the corresponding entry from local_vlan_map.
  if it happens in a bad timing, main thread can end up with raising KeyError.  eg. in port_bound.

  2015-05-15 05:06:34.829 DEBUG neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-800c6e82-4b45-4a7c-bccd-57252f60cb32 DvrRoutersNegativeTest-1077826979 DvrRoutersNegativeTest-2016964618] network_delete received network_delete /opt/stack/new/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py:346
  2015-05-15 05:06:34.829 DEBUG neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-800c6e82-4b45-4a7c-bccd-57252f60cb32 DvrRoutersNegativeTest-1077826979 DvrRoutersNegativeTest-2016964618] Delete 3b74428f-35e1-4b25-b4e8-a06959195d99 network_delete /opt/stack/new/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py:348
  2015-05-15 05:06:34.829 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-800c6e82-4b45-4a7c-bccd-57252f60cb32 DvrRoutersNegativeTest-1077826979 DvrRoutersNegativeTest-2016964618] Reclaiming vlan = 90 from net-id = 3b74428f-35e1-4b25-b4e8-a06959195d99
  2015-05-15 05:06:34.830 DEBUG neutron.agent.linux.utils [req-800c6e82-4b45-4a7c-bccd-57252f60cb32 DvrRoutersNegativeTest-1077826979 DvrRoutersNegativeTest-2016964618] Running command (rootwrap daemon): ['ovs-ofctl', 'del-flows', 'br-tun', '-'] execute_rootwrap_daemon /opt/stack/new/neutron/neutron/agent/linux/utils.py:100
  2015-05-15 05:06:34.830 DEBUG neutron.agent.linux.utils [req-1584b578-b159-4858-bcd1-cdf2650d3bfa None None] 
  Command: ['ovs-ofctl', 'add-flows', 'br-tun', '-']
  Exit code: 0
  Stdin: hard_timeout=0,idle_timeout=0,priority=1,table=4,tun_id=1118,actions=mod_vlan_vid:90,resubmit(,9)
  Stdout:
  Stderr:  execute /opt/stack/new/neutron/neutron/agent/linux/utils.py:134
  2015-05-15 05:06:34.831 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [req-1584b578-b159-4858-bcd1-cdf2650d3bfa None None] Error while processing VIF ports
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last):
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/opt/stack/new/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1518, in rpc_loop
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     ovs_restarted)
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/opt/stack/new/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1291, in process_network_ports
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     devices_added_updated, ovs_restarted))
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/opt/stack/new/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1197, in treat_devices_added_or_updated
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     ovs_restarted)
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/opt/stack/new/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1103, in treat_vif_port
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     fixed_ips, device_owner, ovs_restarted)
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/opt/stack/new/neutron/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 695, in port_bound
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     lvm = self.local_vlan_map[net_uuid]
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent KeyError: u'3b74428f-35e1-4b25-b4e8-a06959195d99'
  2015-05-15 05:06:34.831 25038 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1455338/+subscriptions