yahoo-eng-team team mailing list archive

[Slawek Kaplonski <1818613@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

Various QoS related tests are failing often recently. In all cases
reason is the same: "ovsdbapp.backend.ovs_idl.idlutils.RowNotFound:
Cannot find Port with name=cc566ab0-4201-44b5-ae89-d342284ffdd6" during
"_minimum_bandwidth_initialize".

Stacktrace:

ft1.1: neutron.tests.functional.agent.l2.extensions.test_ovs_agent_qos_extension.TestOVSAgentQosExtension.test_policy_rule_delete(ingress)_StringException: Traceback (most recent call last):
  File "neutron/tests/base.py", line 174, in func
    return f(self, *args, **kwargs)
  File "neutron/tests/functional/agent/l2/extensions/test_ovs_agent_qos_extension.py", line 354, in test_policy_rule_delete
    port_dict = self._create_port_with_qos()
  File "neutron/tests/functional/agent/l2/extensions/test_ovs_agent_qos_extension.py", line 172, in _create_port_with_qos
    self.setup_agent_and_ports([port_dict])
  File "neutron/tests/functional/agent/l2/base.py", line 375, in setup_agent_and_ports
    ancillary_bridge=ancillary_bridge)
  File "neutron/tests/functional/agent/l2/base.py", line 116, in create_agent
    ext_mgr, self.config)
  File "neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 256, in __init__
    self.connection, constants.EXTENSION_DRIVER_TYPE, agent_api)
  File "neutron/agent/agent_extensions_manager.py", line 54, in initialize
    extension.obj.initialize(connection, driver_type)
  File "neutron/agent/l2/extensions/qos.py", line 207, in initialize
    self.qos_driver.initialize()
  File "neutron/plugins/ml2/drivers/openvswitch/agent/extension_drivers/qos_driver.py", line 57, in initialize
    self._minimum_bandwidth_initialize()
  File "neutron/plugins/ml2/drivers/openvswitch/agent/extension_drivers/qos_driver.py", line 52, in _minimum_bandwidth_initialize
    self.br_int.clear_minimum_bandwidth_qos()
  File "neutron/agent/common/ovs_lib.py", line 1006, in clear_minimum_bandwidth_qos
    self.ovsdb.db_destroy('QoS', qos_id).execute(check_error=True)
  File "/opt/stack/new/neutron/.tox/dsvm-functional-python27/local/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 40, in execute
    txn.add(self)
  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
    self.gen.next()
  File "/opt/stack/new/neutron/.tox/dsvm-functional-python27/local/lib/python2.7/site-packages/ovsdbapp/api.py", line 112, in transaction
    del self._nested_txns_map[cur_thread_id]
  File "/opt/stack/new/neutron/.tox/dsvm-functional-python27/local/lib/python2.7/site-packages/ovsdbapp/api.py", line 69, in __exit__
    self.result = self.commit()
  File "/opt/stack/new/neutron/.tox/dsvm-functional-python27/local/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 62, in commit
    raise result.ex
ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Port with name=cc566ab0-4201-44b5-ae89-d342284ffdd6

Example failure: http://logs.openstack.org/74/640874/1/check/neutron-
functional-python27/d51cd50/logs/testr_results.html.gz

Logstash query:
http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22line%2052%2C%20in%20_minimum_bandwidth_initialize%5C%22

** Affects: neutron
     Importance: Critical
         Status: Confirmed


** Tags: functional-tests gate-failure qos

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1818613

Title:
  Functional qos tests fails often

Status in neutron:
  Confirmed

Bug description:
  Various QoS related tests are failing often recently. In all cases
  reason is the same: "ovsdbapp.backend.ovs_idl.idlutils.RowNotFound:
  Cannot find Port with name=cc566ab0-4201-44b5-ae89-d342284ffdd6"
  during "_minimum_bandwidth_initialize".

  Stacktrace:

  ft1.1: neutron.tests.functional.agent.l2.extensions.test_ovs_agent_qos_extension.TestOVSAgentQosExtension.test_policy_rule_delete(ingress)_StringException: Traceback (most recent call last):
    File "neutron/tests/base.py", line 174, in func
      return f(self, *args, **kwargs)
    File "neutron/tests/functional/agent/l2/extensions/test_ovs_agent_qos_extension.py", line 354, in test_policy_rule_delete
      port_dict = self._create_port_with_qos()
    File "neutron/tests/functional/agent/l2/extensions/test_ovs_agent_qos_extension.py", line 172, in _create_port_with_qos
      self.setup_agent_and_ports([port_dict])
    File "neutron/tests/functional/agent/l2/base.py", line 375, in setup_agent_and_ports
      ancillary_bridge=ancillary_bridge)
    File "neutron/tests/functional/agent/l2/base.py", line 116, in create_agent
      ext_mgr, self.config)
    File "neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 256, in __init__
      self.connection, constants.EXTENSION_DRIVER_TYPE, agent_api)
    File "neutron/agent/agent_extensions_manager.py", line 54, in initialize
      extension.obj.initialize(connection, driver_type)
    File "neutron/agent/l2/extensions/qos.py", line 207, in initialize
      self.qos_driver.initialize()
    File "neutron/plugins/ml2/drivers/openvswitch/agent/extension_drivers/qos_driver.py", line 57, in initialize
      self._minimum_bandwidth_initialize()
    File "neutron/plugins/ml2/drivers/openvswitch/agent/extension_drivers/qos_driver.py", line 52, in _minimum_bandwidth_initialize
      self.br_int.clear_minimum_bandwidth_qos()
    File "neutron/agent/common/ovs_lib.py", line 1006, in clear_minimum_bandwidth_qos
      self.ovsdb.db_destroy('QoS', qos_id).execute(check_error=True)
    File "/opt/stack/new/neutron/.tox/dsvm-functional-python27/local/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 40, in execute
      txn.add(self)
    File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
      self.gen.next()
    File "/opt/stack/new/neutron/.tox/dsvm-functional-python27/local/lib/python2.7/site-packages/ovsdbapp/api.py", line 112, in transaction
      del self._nested_txns_map[cur_thread_id]
    File "/opt/stack/new/neutron/.tox/dsvm-functional-python27/local/lib/python2.7/site-packages/ovsdbapp/api.py", line 69, in __exit__
      self.result = self.commit()
    File "/opt/stack/new/neutron/.tox/dsvm-functional-python27/local/lib/python2.7/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 62, in commit
      raise result.ex
  ovsdbapp.backend.ovs_idl.idlutils.RowNotFound: Cannot find Port with name=cc566ab0-4201-44b5-ae89-d342284ffdd6

  Example failure: http://logs.openstack.org/74/640874/1/check/neutron-
  functional-python27/d51cd50/logs/testr_results.html.gz

  Logstash query:
  http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22line%2052%2C%20in%20_minimum_bandwidth_initialize%5C%22

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1818613/+subscriptions