← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #56426

[Bug 1622905] [NEW] test_dualnet_multi_prefix_dhcpv6_stateless fails with 'DetachedInstanceError: Instance <IPAllocation at ...> is not bound to a Session; attribute refresh operation cannot proceed'

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

http://logs.openstack.org/68/367268/4/gate/gate-tempest-dsvm-neutron-
dvr-ubuntu-xenial/da4739d/console.html

2016-09-13 02:23:34.790198 | tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_multi_prefix_dhcpv6_stateless[compute,id-cf1c4425-766b-45b8-be35-e2959728eb00,network]
2016-09-13 02:23:34.790254 | -------------------------------------------------------------------------------------------------------------------------------------------------------
2016-09-13 02:23:34.790263 | 
2016-09-13 02:23:34.790273 | Captured traceback:
2016-09-13 02:23:34.790284 | ~~~~~~~~~~~~~~~~~~~
2016-09-13 02:23:34.790297 |     Traceback (most recent call last):
2016-09-13 02:23:34.790313 |       File "tempest/test.py", line 107, in wrapper
2016-09-13 02:23:34.790329 |         return f(self, *func_args, **func_kwargs)
2016-09-13 02:23:34.790357 |       File "tempest/scenario/test_network_v6.py", line 256, in test_dualnet_multi_prefix_dhcpv6_stateless
2016-09-13 02:23:34.790368 |         dualnet=True)
2016-09-13 02:23:34.790390 |       File "tempest/scenario/test_network_v6.py", line 163, in _prepare_and_test
2016-09-13 02:23:34.790402 |         dualnet=dualnet)
2016-09-13 02:23:34.790424 |       File "tempest/scenario/test_network_v6.py", line 104, in prepare_network
2016-09-13 02:23:34.790436 |         subnet_id=sub6['id'])
2016-09-13 02:23:34.790461 |       File "tempest/lib/services/network/routers_client.py", line 69, in add_router_interface
2016-09-13 02:23:34.790481 |         return self.update_resource(uri, kwargs)
2016-09-13 02:23:34.790504 |       File "tempest/lib/services/network/base.py", line 74, in update_resource
2016-09-13 02:23:34.790520 |         resp, body = self.put(req_uri, req_post_data)
2016-09-13 02:23:34.790539 |       File "tempest/lib/common/rest_client.py", line 340, in put
2016-09-13 02:23:34.790561 |         return self.request('PUT', url, extra_headers, headers, body, chunked)
2016-09-13 02:23:34.790581 |       File "tempest/lib/common/rest_client.py", line 665, in request
2016-09-13 02:23:34.790591 |         resp, resp_body)
2016-09-13 02:23:34.790613 |       File "tempest/lib/common/rest_client.py", line 829, in _error_checker
2016-09-13 02:23:34.790623 |         message=message)
2016-09-13 02:23:34.790640 |     tempest.lib.exceptions.ServerFault: Got server fault
2016-09-13 02:23:34.790663 |     Details: Request Failed: internal server error while processing your request.

In the neutron-server log:

2016-09-13 01:58:24.208 13912 ERROR neutron.plugins.ml2.rpc [req-1ab511fe-43a8-4491-b3d1-a33fd6c797ac - -] Failed to update device 55c41e91-6cf3-4059-8653-3d9727f29674 up
2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers [req-89f26fae-d652-40e8-ba21-43bc4758ace8 admin -] Mechanism driver 'l2population' failed in delete_port_postcommit
2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers Traceback (most recent call last):
2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers   File "/opt/stack/new/neutron/neutron/plugins/ml2/managers.py", line 433, in _call_on_drivers
2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers     getattr(driver.obj, method_name)(context)
2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers   File "/opt/stack/new/neutron/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 80, in delete_port_postcommit
2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers     fdb_entries[network_id]['ports'] = other_fdb_ports
2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers TypeError: 'NoneType' object has no attribute '__getitem__'
2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers 
2016-09-13 02:04:16.835 13911 ERROR neutron.plugins.ml2.plugin [req-89f26fae-d652-40e8-ba21-43bc4758ace8 admin -] mechanism_manager.delete_port_postcommit failed for port cd4447f6-83d3-44ff-b678-7936272d4368
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource [req-7eb6c757-6de0-4f5e-b062-6ccee17e8887 tempest-TestGettingAddress-6985564 -] add_router_interface failed: No details.
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource Traceback (most recent call last):
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 79, in resource
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     result = method(request=request, **args)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     traceback.format_exc())
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 250, in _handle_action
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     ret_value = getattr(self._plugin, name)(*arg_list, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     traceback.format_exc())
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/l3_dvr_db.py", line 415, in add_router_interface
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     port['id'])
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/l3_dvr_db.py", line 385, in add_router_interface
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     {'port': {'fixed_ips': fixed_ips}})
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/common/utils.py", line 618, in inner
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(self, context, *args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     traceback.format_exc())
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1383, in update_port
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     port)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1221, in update_port
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     new_port=new_port)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/ipam_backend_mixin.py", line 725, in update_port
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     new_port.get('mac_address'))
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/ipam_pluggable_backend.py", line 329, in update_port_with_ips
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     new_mac)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/ipam_pluggable_backend.py", line 282, in _update_ips_for_port
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     context, original_ips, new_ips, port['device_owner'])
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/ipam_backend_mixin.py", line 425, in _get_changed_ips_for_port
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     if ip.get('subnet_id') not in delete_subnet_ids]
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 68, in get
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return getattr(self, key, default)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/attributes.py", line 237, in __get__
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return self.impl.get(instance_state(instance), dict_)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/attributes.py", line 578, in get
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     value = state._load_expired(state, passive)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/state.py", line 474, in _load_expired
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.manager.deferred_scalar_loader(self, toload)
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/loading.py", line 610, in load_scalar_attributes
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     (state_str(state)))
2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource DetachedInstanceError: Instance <IPAllocation at 0x7fdafc02db50> is not bound to a Session; attribute refresh operation cannot proceed

** Affects: neutron
     Importance: High
         Status: New


** Tags: gate-failure l3-ipam-dhcp

** Changed in: neutron
   Importance: Undecided => High

** Changed in: neutron
    Milestone: None => newton-rc1

** Tags added: gate-failure l3-ipam-dhcp

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1622905

Title:
  test_dualnet_multi_prefix_dhcpv6_stateless fails with
  'DetachedInstanceError: Instance <IPAllocation at ...> is not bound to
  a Session; attribute refresh operation cannot proceed'

Status in neutron:
  New

Bug description:
  http://logs.openstack.org/68/367268/4/gate/gate-tempest-dsvm-neutron-
  dvr-ubuntu-xenial/da4739d/console.html

  2016-09-13 02:23:34.790198 | tempest.scenario.test_network_v6.TestGettingAddress.test_dualnet_multi_prefix_dhcpv6_stateless[compute,id-cf1c4425-766b-45b8-be35-e2959728eb00,network]
  2016-09-13 02:23:34.790254 | -------------------------------------------------------------------------------------------------------------------------------------------------------
  2016-09-13 02:23:34.790263 | 
  2016-09-13 02:23:34.790273 | Captured traceback:
  2016-09-13 02:23:34.790284 | ~~~~~~~~~~~~~~~~~~~
  2016-09-13 02:23:34.790297 |     Traceback (most recent call last):
  2016-09-13 02:23:34.790313 |       File "tempest/test.py", line 107, in wrapper
  2016-09-13 02:23:34.790329 |         return f(self, *func_args, **func_kwargs)
  2016-09-13 02:23:34.790357 |       File "tempest/scenario/test_network_v6.py", line 256, in test_dualnet_multi_prefix_dhcpv6_stateless
  2016-09-13 02:23:34.790368 |         dualnet=True)
  2016-09-13 02:23:34.790390 |       File "tempest/scenario/test_network_v6.py", line 163, in _prepare_and_test
  2016-09-13 02:23:34.790402 |         dualnet=dualnet)
  2016-09-13 02:23:34.790424 |       File "tempest/scenario/test_network_v6.py", line 104, in prepare_network
  2016-09-13 02:23:34.790436 |         subnet_id=sub6['id'])
  2016-09-13 02:23:34.790461 |       File "tempest/lib/services/network/routers_client.py", line 69, in add_router_interface
  2016-09-13 02:23:34.790481 |         return self.update_resource(uri, kwargs)
  2016-09-13 02:23:34.790504 |       File "tempest/lib/services/network/base.py", line 74, in update_resource
  2016-09-13 02:23:34.790520 |         resp, body = self.put(req_uri, req_post_data)
  2016-09-13 02:23:34.790539 |       File "tempest/lib/common/rest_client.py", line 340, in put
  2016-09-13 02:23:34.790561 |         return self.request('PUT', url, extra_headers, headers, body, chunked)
  2016-09-13 02:23:34.790581 |       File "tempest/lib/common/rest_client.py", line 665, in request
  2016-09-13 02:23:34.790591 |         resp, resp_body)
  2016-09-13 02:23:34.790613 |       File "tempest/lib/common/rest_client.py", line 829, in _error_checker
  2016-09-13 02:23:34.790623 |         message=message)
  2016-09-13 02:23:34.790640 |     tempest.lib.exceptions.ServerFault: Got server fault
  2016-09-13 02:23:34.790663 |     Details: Request Failed: internal server error while processing your request.

  In the neutron-server log:

  2016-09-13 01:58:24.208 13912 ERROR neutron.plugins.ml2.rpc [req-1ab511fe-43a8-4491-b3d1-a33fd6c797ac - -] Failed to update device 55c41e91-6cf3-4059-8653-3d9727f29674 up
  2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers [req-89f26fae-d652-40e8-ba21-43bc4758ace8 admin -] Mechanism driver 'l2population' failed in delete_port_postcommit
  2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers Traceback (most recent call last):
  2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers   File "/opt/stack/new/neutron/neutron/plugins/ml2/managers.py", line 433, in _call_on_drivers
  2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers     getattr(driver.obj, method_name)(context)
  2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers   File "/opt/stack/new/neutron/neutron/plugins/ml2/drivers/l2pop/mech_driver.py", line 80, in delete_port_postcommit
  2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers     fdb_entries[network_id]['ports'] = other_fdb_ports
  2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers TypeError: 'NoneType' object has no attribute '__getitem__'
  2016-09-13 02:04:16.827 13911 ERROR neutron.plugins.ml2.managers 
  2016-09-13 02:04:16.835 13911 ERROR neutron.plugins.ml2.plugin [req-89f26fae-d652-40e8-ba21-43bc4758ace8 admin -] mechanism_manager.delete_port_postcommit failed for port cd4447f6-83d3-44ff-b678-7936272d4368
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource [req-7eb6c757-6de0-4f5e-b062-6ccee17e8887 tempest-TestGettingAddress-6985564 -] add_router_interface failed: No details.
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource Traceback (most recent call last):
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 79, in resource
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     result = method(request=request, **args)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     traceback.format_exc())
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 250, in _handle_action
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     ret_value = getattr(self._plugin, name)(*arg_list, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     traceback.format_exc())
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/l3_dvr_db.py", line 415, in add_router_interface
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     port['id'])
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/l3_dvr_db.py", line 385, in add_router_interface
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     {'port': {'fixed_ips': fixed_ips}})
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/common/utils.py", line 618, in inner
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(self, context, *args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 87, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 83, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 123, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     traceback.format_exc())
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.force_reraise()
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 118, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1383, in update_port
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     port)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 155, in wrapped
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1221, in update_port
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     new_port=new_port)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/ipam_backend_mixin.py", line 725, in update_port
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     new_port.get('mac_address'))
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/ipam_pluggable_backend.py", line 329, in update_port_with_ips
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     new_mac)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/ipam_pluggable_backend.py", line 282, in _update_ips_for_port
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     context, original_ips, new_ips, port['device_owner'])
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/ipam_backend_mixin.py", line 425, in _get_changed_ips_for_port
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     if ip.get('subnet_id') not in delete_subnet_ids]
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/sqlalchemy/models.py", line 68, in get
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return getattr(self, key, default)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/attributes.py", line 237, in __get__
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     return self.impl.get(instance_state(instance), dict_)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/attributes.py", line 578, in get
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     value = state._load_expired(state, passive)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/state.py", line 474, in _load_expired
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     self.manager.deferred_scalar_loader(self, toload)
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/loading.py", line 610, in load_scalar_attributes
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource     (state_str(state)))
  2016-09-13 02:11:23.858 13910 ERROR neutron.api.v2.resource DetachedInstanceError: Instance <IPAllocation at 0x7fdafc02db50> is not bound to a Session; attribute refresh operation cannot proceed

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1622905/+subscriptions
  Thread Previous • Date Previous • • Thread Next