← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #36970

[Bug 1485969] [NEW] test_dualnet_multi_prefix_dhcpv6_stateless failed due to "RuntimeError: Set changed size during iteration" in quota code

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

The failure is: http://logs.openstack.org/13/213913/3/check/gate-
tempest-dsvm-neutron-full/1d73a46/logs/testr_results.html.gz

Nova failed to build an instance because neutron crashed with
InternalError. In neutron-server.log, we see:

2015-08-18 05:08:05.737 ERROR neutron.api.v2.resource [req-2fb6728e-f7f0-492c-bdf6-0b76d553932b neutron service] create failed
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource Traceback (most recent call last):
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 83, in resource
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     result = method(request=request, **args)
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 146, in wrapper
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 119, in __exit__
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 136, in wrapper
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 495, in create
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     obj)})
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 459, in notify
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     resource_registry.set_resources_dirty(request.context)
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/quota/resource_registry.py", line 70, in set_resources_dirty
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     res.mark_dirty(context, nested=True)
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 252, in inner
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/quota/resource.py", line 185, in mark_dirty
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     for tenant_id in self._dirty_tenants:
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource RuntimeError: Set changed size during iteration
2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource 

Apparently, we should make sure the loop does not operate on a set that
is changing under the hood.

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1485969

Title:
  test_dualnet_multi_prefix_dhcpv6_stateless failed due to
  "RuntimeError: Set changed size during iteration" in quota code

Status in neutron:
  New

Bug description:
  The failure is: http://logs.openstack.org/13/213913/3/check/gate-
  tempest-dsvm-neutron-full/1d73a46/logs/testr_results.html.gz

  Nova failed to build an instance because neutron crashed with
  InternalError. In neutron-server.log, we see:

  2015-08-18 05:08:05.737 ERROR neutron.api.v2.resource [req-2fb6728e-f7f0-492c-bdf6-0b76d553932b neutron service] create failed
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource Traceback (most recent call last):
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 83, in resource
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     result = method(request=request, **args)
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 146, in wrapper
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 119, in __exit__
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 136, in wrapper
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 495, in create
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     obj)})
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 459, in notify
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     resource_registry.set_resources_dirty(request.context)
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/quota/resource_registry.py", line 70, in set_resources_dirty
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     res.mark_dirty(context, nested=True)
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 252, in inner
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/quota/resource.py", line 185, in mark_dirty
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource     for tenant_id in self._dirty_tenants:
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource RuntimeError: Set changed size during iteration
  2015-08-18 05:08:05.737 26601 ERROR neutron.api.v2.resource 

  Apparently, we should make sure the loop does not operate on a set
  that is changing under the hood.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1485969/+subscriptions

Follow ups

  Thread Previous • Date Previous • • Thread Next