← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #14730

[Bug 1323682] [NEW] openvswitch-agent prepare filter for devices crashes in exception AttributeError , and resyncs in a loop

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

openvswitch agent starts a loop trying to process the response from
security_group_rules_for_devices RPC,

a change was introduced to neutron-server, where network owned devices are excluded from the response [1]
returning None.

but the ovs_neutron_agent logic is not ready to handle that.


2014-05-21 08:32:28.447 12264 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'cc38bf6c-db87-4302-b225-73ddf4bf1972'])
2014-05-21 08:32:28.543 12264 INFO neutron.openstack.common.lockutils [-] Created lock path: /var/lib/neutron/lock
2014-05-21 08:32:28.776 12264 INFO neutron.agent.securitygroups_rpc [req-097f4571-3ce4-4ab1-81af-c59a9febc121 None] Security group member updated [u'1809f907-4b0c-4445-a366-ff28eaab9c2e']
2014-05-21 08:32:29.070 12264 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while processing VIF ports
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last):
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1226, in rpc_loop
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     sync = self.process_network_ports(port_info)
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1069, in process_network_ports
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info.get('updated', set()))
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py", line 247, in setup_port_filters
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     self.prepare_devices_filter(new_devices)
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py", line 163, in prepare_devices_filter
2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     for device in devices.values():


2014-05-21 08:32:29.070 12264 TRACE
neutron.plugins.openvswitch.agent.ovs_neutron_agent AttributeError:
'NoneType' object has no attribute 'values'


2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent 
2014-05-21 08:32:29.948 12264 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync with plugin!


[1] https://github.com/openstack/neutron/blob/master/neutron/db/securitygroups_rpc_base.py#L147
[2] https://github.com/openstack/neutron/blob/master/neutron/agent/securitygroups_rpc.py#L163 
      and https://github.com/openstack/neutron/blob/master/neutron/agent/securitygroups_rpc.py#L227

** Affects: neutron
     Importance: Undecided
     Assignee: Miguel Angel Ajo (mangelajo)
         Status: In Progress

** Changed in: neutron
     Assignee: (unassigned) => Miguel Angel Ajo (mangelajo)

** Changed in: neutron
       Status: New => In Progress

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1323682

Title:
  openvswitch-agent prepare filter for devices crashes in exception
  AttributeError , and resyncs in a loop

Status in OpenStack Neutron (virtual network service):
  In Progress

Bug description:
  openvswitch agent starts a loop trying to process the response from
  security_group_rules_for_devices RPC,

  a change was introduced to neutron-server, where network owned devices are excluded from the response [1]
  returning None.

  but the ovs_neutron_agent logic is not ready to handle that.

  
  2014-05-21 08:32:28.447 12264 INFO neutron.agent.securitygroups_rpc [-] Preparing filters for devices set([u'cc38bf6c-db87-4302-b225-73ddf4bf1972'])
  2014-05-21 08:32:28.543 12264 INFO neutron.openstack.common.lockutils [-] Created lock path: /var/lib/neutron/lock
  2014-05-21 08:32:28.776 12264 INFO neutron.agent.securitygroups_rpc [req-097f4571-3ce4-4ab1-81af-c59a9febc121 None] Security group member updated [u'1809f907-4b0c-4445-a366-ff28eaab9c2e']
  2014-05-21 08:32:29.070 12264 ERROR neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Error while processing VIF ports
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent Traceback (most recent call last):
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1226, in rpc_loop
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     sync = self.process_network_ports(port_info)
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/plugins/openvswitch/agent/ovs_neutron_agent.py", line 1069, in process_network_ports
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     port_info.get('updated', set()))
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py", line 247, in setup_port_filters
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     self.prepare_devices_filter(new_devices)
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent   File "/usr/lib/python2.7/site-packages/neutron/agent/securitygroups_rpc.py", line 163, in prepare_devices_filter
  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent     for device in devices.values():


  2014-05-21 08:32:29.070 12264 TRACE
  neutron.plugins.openvswitch.agent.ovs_neutron_agent AttributeError:
  'NoneType' object has no attribute 'values'


  2014-05-21 08:32:29.070 12264 TRACE neutron.plugins.openvswitch.agent.ovs_neutron_agent 
  2014-05-21 08:32:29.948 12264 INFO neutron.plugins.openvswitch.agent.ovs_neutron_agent [-] Agent out of sync with plugin!

  
  [1] https://github.com/openstack/neutron/blob/master/neutron/db/securitygroups_rpc_base.py#L147
  [2] https://github.com/openstack/neutron/blob/master/neutron/agent/securitygroups_rpc.py#L163 
        and https://github.com/openstack/neutron/blob/master/neutron/agent/securitygroups_rpc.py#L227

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1323682/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next