← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #35388

[Bug 1475253] [NEW] occational FT failure with "Row removed from DB"

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOiBcIlJ1bnRpbWVFcnJvcjogUm93IHJlbW92ZWQgZnJvbSBEQiBkdXJpbmcgbGlzdGluZy4gUmVxdWVzdCBpbmZvOiBUYWJsZT1Qb3J0LiBDb2x1bW5zPVsnbmFtZScsICdvdGhlcl9jb25maWcnLCAndGFnJ10uIFJlY29yZHM9Tm9uZS5cIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQzNzA0Mzk3MDE3NH0=


ft1.48: neutron.tests.functional.agent.test_l2_ovs_agent.TestOVSAgent.test_assert_bridges_ports_vxlan(native)_StringException: Empty attachments:
  pythonlogging:'neutron.api.extensions'
  stderr
  stdout

pythonlogging:'': {{{
2015-07-16 05:45:28,544     INFO [neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent] Mapping physical network physnet to bridge br-int746017284
2015-07-16 05:45:28,582  WARNING [neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent] Creating an interface named br-int746017284 exceeds the 15 character limitation. It was shortened to int-br-inc6274e to fit.
2015-07-16 05:45:28,582  WARNING [neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent] Creating an interface named br-int746017284 exceeds the 15 character limitation. It was shortened to phy-br-inc6274e to fit.
2015-07-16 05:45:29,206    ERROR [neutron.agent.ovsdb.impl_idl] Traceback (most recent call last):
  File "neutron/agent/ovsdb/native/connection.py", line 84, in run
    txn.results.put(txn.do_commit())
  File "neutron/agent/ovsdb/impl_idl.py", line 92, in do_commit
    ctx.reraise = False
  File "/opt/stack/new/neutron/.tox/dsvm-functional/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 119, in __exit__
    six.reraise(self.type_, self.value, self.tb)
  File "neutron/agent/ovsdb/impl_idl.py", line 87, in do_commit
    command.run_idl(txn)
  File "neutron/agent/ovsdb/native/commands.py", line 389, in run_idl
    "Records=%(records)s.") % self.requested_info)
RuntimeError: Row removed from DB during listing. Request info: Table=Port. Columns=['name', 'other_config', 'tag']. Records=None.

2015-07-16 05:45:29,207    ERROR [neutron.agent.ovsdb.native.commands] Error executing command
Traceback (most recent call last):
  File "neutron/agent/ovsdb/native/commands.py", line 35, in execute
    txn.add(self)
  File "neutron/agent/ovsdb/api.py", line 70, in __exit__
    self.result = self.commit()
  File "neutron/agent/ovsdb/impl_idl.py", line 70, in commit
    raise result.ex
RuntimeError: Row removed from DB during listing. Request info: Table=Port. Columns=['name', 'other_config', 'tag']. Records=None.
}}}

Traceback (most recent call last):
  File "neutron/tests/functional/agent/test_l2_ovs_agent.py", line 284, in test_assert_bridges_ports_vxlan
    agent = self.create_agent()
  File "neutron/tests/functional/agent/test_l2_ovs_agent.py", line 112, in create_agent
    conf=self.config)
  File "neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 281, in __init__
    self._restore_local_vlan_map()
  File "neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 316, in _restore_local_vlan_map
    "Port", columns=["name", "other_config", "tag"])
  File "neutron/agent/common/ovs_lib.py", line 148, in db_list
    execute(check_error=check_error, log_errors=log_errors))
  File "neutron/agent/ovsdb/native/commands.py", line 42, in execute
    ctx.reraise = False
  File "/opt/stack/new/neutron/.tox/dsvm-functional/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 119, in __exit__
    six.reraise(self.type_, self.value, self.tb)
  File "neutron/agent/ovsdb/native/commands.py", line 35, in execute
    txn.add(self)
  File "neutron/agent/ovsdb/api.py", line 70, in __exit__
    self.result = self.commit()
  File "neutron/agent/ovsdb/impl_idl.py", line 70, in commit
    raise result.ex
RuntimeError: Row removed from DB during listing. Request info: Table=Port. Columns=['name', 'other_config', 'tag']. Records=None.

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1475253

Title:
  occational FT failure with "Row removed from DB"

Status in neutron:
  New

Bug description:
  http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOiBcIlJ1bnRpbWVFcnJvcjogUm93IHJlbW92ZWQgZnJvbSBEQiBkdXJpbmcgbGlzdGluZy4gUmVxdWVzdCBpbmZvOiBUYWJsZT1Qb3J0LiBDb2x1bW5zPVsnbmFtZScsICdvdGhlcl9jb25maWcnLCAndGFnJ10uIFJlY29yZHM9Tm9uZS5cIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQzNzA0Mzk3MDE3NH0=

  
  ft1.48: neutron.tests.functional.agent.test_l2_ovs_agent.TestOVSAgent.test_assert_bridges_ports_vxlan(native)_StringException: Empty attachments:
    pythonlogging:'neutron.api.extensions'
    stderr
    stdout

  pythonlogging:'': {{{
  2015-07-16 05:45:28,544     INFO [neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent] Mapping physical network physnet to bridge br-int746017284
  2015-07-16 05:45:28,582  WARNING [neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent] Creating an interface named br-int746017284 exceeds the 15 character limitation. It was shortened to int-br-inc6274e to fit.
  2015-07-16 05:45:28,582  WARNING [neutron.plugins.ml2.drivers.openvswitch.agent.ovs_neutron_agent] Creating an interface named br-int746017284 exceeds the 15 character limitation. It was shortened to phy-br-inc6274e to fit.
  2015-07-16 05:45:29,206    ERROR [neutron.agent.ovsdb.impl_idl] Traceback (most recent call last):
    File "neutron/agent/ovsdb/native/connection.py", line 84, in run
      txn.results.put(txn.do_commit())
    File "neutron/agent/ovsdb/impl_idl.py", line 92, in do_commit
      ctx.reraise = False
    File "/opt/stack/new/neutron/.tox/dsvm-functional/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 119, in __exit__
      six.reraise(self.type_, self.value, self.tb)
    File "neutron/agent/ovsdb/impl_idl.py", line 87, in do_commit
      command.run_idl(txn)
    File "neutron/agent/ovsdb/native/commands.py", line 389, in run_idl
      "Records=%(records)s.") % self.requested_info)
  RuntimeError: Row removed from DB during listing. Request info: Table=Port. Columns=['name', 'other_config', 'tag']. Records=None.

  2015-07-16 05:45:29,207    ERROR [neutron.agent.ovsdb.native.commands] Error executing command
  Traceback (most recent call last):
    File "neutron/agent/ovsdb/native/commands.py", line 35, in execute
      txn.add(self)
    File "neutron/agent/ovsdb/api.py", line 70, in __exit__
      self.result = self.commit()
    File "neutron/agent/ovsdb/impl_idl.py", line 70, in commit
      raise result.ex
  RuntimeError: Row removed from DB during listing. Request info: Table=Port. Columns=['name', 'other_config', 'tag']. Records=None.
  }}}

  Traceback (most recent call last):
    File "neutron/tests/functional/agent/test_l2_ovs_agent.py", line 284, in test_assert_bridges_ports_vxlan
      agent = self.create_agent()
    File "neutron/tests/functional/agent/test_l2_ovs_agent.py", line 112, in create_agent
      conf=self.config)
    File "neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 281, in __init__
      self._restore_local_vlan_map()
    File "neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 316, in _restore_local_vlan_map
      "Port", columns=["name", "other_config", "tag"])
    File "neutron/agent/common/ovs_lib.py", line 148, in db_list
      execute(check_error=check_error, log_errors=log_errors))
    File "neutron/agent/ovsdb/native/commands.py", line 42, in execute
      ctx.reraise = False
    File "/opt/stack/new/neutron/.tox/dsvm-functional/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 119, in __exit__
      six.reraise(self.type_, self.value, self.tb)
    File "neutron/agent/ovsdb/native/commands.py", line 35, in execute
      txn.add(self)
    File "neutron/agent/ovsdb/api.py", line 70, in __exit__
      self.result = self.commit()
    File "neutron/agent/ovsdb/impl_idl.py", line 70, in commit
      raise result.ex
  RuntimeError: Row removed from DB during listing. Request info: Table=Port. Columns=['name', 'other_config', 'tag']. Records=None.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1475253/+subscriptions
  Thread Previous • Date Previous • • Thread Next