yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1421132] [NEW] test_rebuild_availability_range is failing from time to time

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Rossella Sblendido <rsblendido@xxxxxxxx>
Date: Thu, 12 Feb 2015 09:36:57 -0000
Reply-to: Bug 1421132 <1421132@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Functional test test_rebuild_availability_range is failing quite often
with the following stacktrace:

2015-02-11 02:48:31.256 | 2015-02-11 02:48:29.890 |     Traceback (most recent call last):
2015-02-11 02:48:31.256 | 2015-02-11 02:48:29.892 |       File "neutron/tests/functional/db/test_ipam.py", line 198, in test_rebuild_availability_range
2015-02-11 02:48:31.257 | 2015-02-11 02:48:29.893 |         self._create_port(self.port_id)
2015-02-11 02:48:31.257 | 2015-02-11 02:48:29.894 |       File "neutron/tests/functional/db/test_ipam.py", line 128, in _create_port
2015-02-11 02:48:31.258 | 2015-02-11 02:48:29.896 |         self.plugin.create_port(self.cxt, {'port': port})
2015-02-11 02:48:31.258 | 2015-02-11 02:48:29.897 |       File "neutron/db/db_base_plugin_v2.py", line 1356, in create_port
2015-02-11 02:48:31.258 | 2015-02-11 02:48:29.898 |         context, ip_address, network_id, subnet_id, port_id)
2015-02-11 02:48:31.259 | 2015-02-11 02:48:29.900 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 470, in __exit__
2015-02-11 02:48:31.259 | 2015-02-11 02:48:29.901 |         self.rollback()
2015-02-11 02:48:31.260 | 2015-02-11 02:48:29.902 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
2015-02-11 02:48:31.260 | 2015-02-11 02:48:29.904 |         compat.reraise(exc_type, exc_value, exc_tb)
2015-02-11 02:48:35.598 | 2015-02-11 02:48:29.905 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 467, in __exit__
2015-02-11 02:48:35.599 | 2015-02-11 02:48:29.906 |         self.commit()
2015-02-11 02:48:35.600 | 2015-02-11 02:48:29.907 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 377, in commit
2015-02-11 02:48:35.601 | 2015-02-11 02:48:29.909 |         self._prepare_impl()
2015-02-11 02:48:35.601 | 2015-02-11 02:48:29.910 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 357, in _prepare_impl
2015-02-11 02:48:35.602 | 2015-02-11 02:48:29.911 |         self.session.flush()
2015-02-11 02:48:35.603 | 2015-02-11 02:48:29.913 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 1919, in flush
2015-02-11 02:48:35.603 | 2015-02-11 02:48:29.914 |         self._flush(objects)
2015-02-11 02:48:35.604 | 2015-02-11 02:48:29.915 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2037, in _flush
2015-02-11 02:48:35.605 | 2015-02-11 02:48:29.917 |         transaction.rollback(_capture_exception=True)
2015-02-11 02:48:35.605 | 2015-02-11 02:48:29.918 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
2015-02-11 02:48:35.606 | 2015-02-11 02:48:29.919 |         compat.reraise(exc_type, exc_value, exc_tb)
2015-02-11 02:48:35.607 | 2015-02-11 02:48:29.921 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2001, in _flush
2015-02-11 02:48:35.608 | 2015-02-11 02:48:29.922 |         flush_context.execute()
2015-02-11 02:48:35.608 | 2015-02-11 02:48:29.923 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 372, in execute
2015-02-11 02:48:35.609 | 2015-02-11 02:48:29.925 |         rec.execute(self)
2015-02-11 02:48:35.610 | 2015-02-11 02:48:29.926 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 526, in execute
2015-02-11 02:48:35.610 | 2015-02-11 02:48:29.927 |         uow
2015-02-11 02:48:35.611 | 2015-02-11 02:48:29.929 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 46, in save_obj
2015-02-11 02:48:35.612 | 2015-02-11 02:48:29.930 |         uowtransaction)
2015-02-11 02:48:35.612 | 2015-02-11 02:48:29.931 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 171, in _organize_states_for_save
2015-02-11 02:48:35.613 | 2015-02-11 02:48:29.933 |         state_str(existing)))
2015-02-11 02:48:35.614 | 2015-02-11 02:48:29.934 |     FlushError: New instance <IPAllocation at 0x7fdadf237d10> with identity key (<class 'neutron.db.models_v2.IPAllocation'>, (u'10.10.10.2', u'test_sub_id', 'test_net_id')) conflicts with persistent instance <IPAllocation at 0x7fdad2488cd0>


See for example http://logs.openstack.org/35/149735/4/gate/gate-neutron-dsvm-functional/fc960fe/console.html

Logstack query:
http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiRmx1c2hFcnJvclwiICBBTkQgdGFnczpcImNvbnNvbGUuaHRtbFwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiIxNzI4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDIzNzMzNTU0NDc5LCJtb2RlIjoiIiwiYW5hbHl6ZV9maWVsZCI6IiJ9

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1421132

Title:
  test_rebuild_availability_range is failing from time to time

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  Functional test test_rebuild_availability_range is failing quite often
  with the following stacktrace:

  2015-02-11 02:48:31.256 | 2015-02-11 02:48:29.890 |     Traceback (most recent call last):
  2015-02-11 02:48:31.256 | 2015-02-11 02:48:29.892 |       File "neutron/tests/functional/db/test_ipam.py", line 198, in test_rebuild_availability_range
  2015-02-11 02:48:31.257 | 2015-02-11 02:48:29.893 |         self._create_port(self.port_id)
  2015-02-11 02:48:31.257 | 2015-02-11 02:48:29.894 |       File "neutron/tests/functional/db/test_ipam.py", line 128, in _create_port
  2015-02-11 02:48:31.258 | 2015-02-11 02:48:29.896 |         self.plugin.create_port(self.cxt, {'port': port})
  2015-02-11 02:48:31.258 | 2015-02-11 02:48:29.897 |       File "neutron/db/db_base_plugin_v2.py", line 1356, in create_port
  2015-02-11 02:48:31.258 | 2015-02-11 02:48:29.898 |         context, ip_address, network_id, subnet_id, port_id)
  2015-02-11 02:48:31.259 | 2015-02-11 02:48:29.900 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 470, in __exit__
  2015-02-11 02:48:31.259 | 2015-02-11 02:48:29.901 |         self.rollback()
  2015-02-11 02:48:31.260 | 2015-02-11 02:48:29.902 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
  2015-02-11 02:48:31.260 | 2015-02-11 02:48:29.904 |         compat.reraise(exc_type, exc_value, exc_tb)
  2015-02-11 02:48:35.598 | 2015-02-11 02:48:29.905 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 467, in __exit__
  2015-02-11 02:48:35.599 | 2015-02-11 02:48:29.906 |         self.commit()
  2015-02-11 02:48:35.600 | 2015-02-11 02:48:29.907 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 377, in commit
  2015-02-11 02:48:35.601 | 2015-02-11 02:48:29.909 |         self._prepare_impl()
  2015-02-11 02:48:35.601 | 2015-02-11 02:48:29.910 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 357, in _prepare_impl
  2015-02-11 02:48:35.602 | 2015-02-11 02:48:29.911 |         self.session.flush()
  2015-02-11 02:48:35.603 | 2015-02-11 02:48:29.913 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 1919, in flush
  2015-02-11 02:48:35.603 | 2015-02-11 02:48:29.914 |         self._flush(objects)
  2015-02-11 02:48:35.604 | 2015-02-11 02:48:29.915 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2037, in _flush
  2015-02-11 02:48:35.605 | 2015-02-11 02:48:29.917 |         transaction.rollback(_capture_exception=True)
  2015-02-11 02:48:35.605 | 2015-02-11 02:48:29.918 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
  2015-02-11 02:48:35.606 | 2015-02-11 02:48:29.919 |         compat.reraise(exc_type, exc_value, exc_tb)
  2015-02-11 02:48:35.607 | 2015-02-11 02:48:29.921 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2001, in _flush
  2015-02-11 02:48:35.608 | 2015-02-11 02:48:29.922 |         flush_context.execute()
  2015-02-11 02:48:35.608 | 2015-02-11 02:48:29.923 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 372, in execute
  2015-02-11 02:48:35.609 | 2015-02-11 02:48:29.925 |         rec.execute(self)
  2015-02-11 02:48:35.610 | 2015-02-11 02:48:29.926 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 526, in execute
  2015-02-11 02:48:35.610 | 2015-02-11 02:48:29.927 |         uow
  2015-02-11 02:48:35.611 | 2015-02-11 02:48:29.929 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 46, in save_obj
  2015-02-11 02:48:35.612 | 2015-02-11 02:48:29.930 |         uowtransaction)
  2015-02-11 02:48:35.612 | 2015-02-11 02:48:29.931 |       File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 171, in _organize_states_for_save
  2015-02-11 02:48:35.613 | 2015-02-11 02:48:29.933 |         state_str(existing)))
  2015-02-11 02:48:35.614 | 2015-02-11 02:48:29.934 |     FlushError: New instance <IPAllocation at 0x7fdadf237d10> with identity key (<class 'neutron.db.models_v2.IPAllocation'>, (u'10.10.10.2', u'test_sub_id', 'test_net_id')) conflicts with persistent instance <IPAllocation at 0x7fdad2488cd0>

  
  See for example http://logs.openstack.org/35/149735/4/gate/gate-neutron-dsvm-functional/fc960fe/console.html

  Logstack query:
  http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiRmx1c2hFcnJvclwiICBBTkQgdGFnczpcImNvbnNvbGUuaHRtbFwiIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiIxNzI4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDIzNzMzNTU0NDc5LCJtb2RlIjoiIiwiYW5hbHl6ZV9maWVsZCI6IiJ9

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1421132/+subscriptions
Follow ups

[Bug 1421132] Re: test_rebuild_availability_range is failing from time to time
From: Launchpad Bug Tracker, 2015-05-31
[Bug 1421132] [NEW] test_rebuild_availability_range is failing from time to time
From: Rossella Sblendido, 2015-02-12
References

[Bug 1421132] [NEW] test_rebuild_availability_range is failing from time to time
From: Rossella Sblendido, 2015-02-12