yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1625316] Re: gate-tempest-dsvm-neutron-full-ubuntu-xenial failed on test tempest.api.network.test_ports.PortsIpV6TestJSON

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Ken'ichi Ohmichi <ken1ohmichi@xxxxxxxxx>
Date: Tue, 22 Nov 2016 22:16:23 -0000
Reply-to: Bug 1625316 <1625316@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
neutron-server shows traceback in its own log.

screen-q-svc.txt.gz:

2016-09-19 18:20:58.477 12886 DEBUG neutron.wsgi [-] (12886) accepted ('127.0.0.1', 35944) server /usr/local/lib/python2.7/dist-packages/eventlet/wsgi.py:868
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource [req-31421a79-db66-416e-a8a8-6d8fd1391ea5 tempest-PortsIpV6TestJSON-1130586331 -] delete failed: Exception deleting fixed_ip from
 port f47f6299-2285-424f-8236-27abdd26aa71
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource Traceback (most recent call last):
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 79, in resource
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     result = method(request=request, **args)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 555, in delete
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return self._delete(request, id, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 88, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 84, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 124, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     traceback.format_exc())
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 119, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 577, in _delete
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     obj_deleter(request.context, id, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/common/utils.py", line 618, in inner
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(self, context, *args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 159, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 88, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 84, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 124, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     traceback.format_exc())
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 119, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1182, in delete_subnet
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     "port %s"), port_id)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1168, in delete_subnet
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.update_port(context, port_id, data)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/common/utils.py", line 618, in inner
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(self, context, *args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 159, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 88, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     setattr(e, '_RETRY_EXCEEDED', True)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 84, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 151, in wrapper
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 139, in wrapper
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 124, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     traceback.format_exc())
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.force_reraise()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 119, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return f(*dup_args, **dup_kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1397, in update_port
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     port)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/api.py", line 159, in wrapped
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/db_base_plugin_v2.py", line 1221, in update_port
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     new_port=new_port)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 490, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.rollback()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     compat.reraise(exc_type, exc_value, exc_tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 487, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.commit()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 392, in commit
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self._prepare_impl()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 372, in _prepare_impl
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self.session.flush()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2019, in flush
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     self._flush(objects)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2137, in _flush
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     transaction.rollback(_capture_exception=True)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     compat.reraise(exc_type, exc_value, exc_tb)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 2101, in _flush
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     flush_context.execute()
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     rec.execute(self)
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     uow
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 149, in save_obj
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     base_mapper, states, uowtransaction
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/persistence.py", line 301, in _organize_states_for_save
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource     state_str(existing)))
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource FlushError: New instance <IPAllocation at 0x7fa36e1eea50> with identity key (<class 'neutron.db.models_v2.IPAllocation'>, ('2003:0:0:2::3', u'de3343f2-88a8-4213-981d-940c3aa70f73', u'77c71aff-f5aa-439b-a631-d4c66e7f28c1')) conflicts with persistent instance <IPAllocation at 0x7fa36da26ed0>
2016-09-19 18:20:58.480 12886 ERROR neutron.api.v2.resource

** Changed in: tempest
       Status: New => Confirmed

** Changed in: tempest
   Importance: Undecided => Medium

** Also affects: neutron
   Importance: Undecided
       Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1625316

Title:
  gate-tempest-dsvm-neutron-full-ubuntu-xenial failed on test
  tempest.api.network.test_ports.PortsIpV6TestJSON

Status in neutron:
  New
Status in tempest:
  Confirmed

Bug description:
  gate-tempest-dsvm-neutron-full-ubuntu-xenial failed on test
  tempest.api.network.test_ports.PortsIpV6TestJSON.

  Log:
  2016-09-19 18:29:59.690836 | ==============================
  2016-09-19 18:29:59.690860 | Failed 1 tests - output below:
  2016-09-19 18:29:59.690880 | ==============================
  2016-09-19 18:29:59.690892 | 
  2016-09-19 18:29:59.690919 | tearDownClass (tempest.api.network.test_ports.PortsIpV6TestJSON)
  2016-09-19 18:29:59.690947 | ----------------------------------------------------------------
  2016-09-19 18:29:59.690958 | 
  2016-09-19 18:29:59.690975 | Captured traceback:
  2016-09-19 18:29:59.690992 | ~~~~~~~~~~~~~~~~~~~
  2016-09-19 18:29:59.691013 |     Traceback (most recent call last):
  2016-09-19 18:29:59.691041 |       File "tempest/test.py", line 312, in tearDownClass
  2016-09-19 18:29:59.691062 |         six.reraise(etype, value, trace)
  2016-09-19 18:29:59.691087 |       File "tempest/test.py", line 295, in tearDownClass
  2016-09-19 18:29:59.691103 |         teardown()
  2016-09-19 18:29:59.691133 |       File "tempest/api/network/base.py", line 130, in resource_cleanup
  2016-09-19 18:29:59.691158 |         cls.subnets_client.delete_subnet, subnet['id'])
  2016-09-19 18:29:59.691196 |       File "tempest/lib/common/utils/test_utils.py", line 84, in call_and_ignore_notfound_exc
  2016-09-19 18:29:59.691221 |         return func(*args, **kwargs)
  2016-09-19 18:29:59.691254 |       File "tempest/lib/services/network/subnets_client.py", line 52, in delete_subnet
  2016-09-19 18:29:59.691279 |         return self.delete_resource(uri)
  2016-09-19 18:29:59.691310 |       File "tempest/lib/services/network/base.py", line 41, in delete_resource
  2016-09-19 18:29:59.691333 |         resp, body = self.delete(req_uri)
  2016-09-19 18:29:59.691361 |       File "tempest/lib/common/rest_client.py", line 307, in delete
  2016-09-19 18:29:59.691390 |         return self.request('DELETE', url, extra_headers, headers, body)
  2016-09-19 18:29:59.691419 |       File "tempest/lib/common/rest_client.py", line 665, in request
  2016-09-19 18:29:59.691438 |         resp, resp_body)
  2016-09-19 18:29:59.691468 |       File "tempest/lib/common/rest_client.py", line 829, in _error_checker
  2016-09-19 18:29:59.691485 |         message=message)
  2016-09-19 18:29:59.691510 |     tempest.lib.exceptions.ServerFault: Got server fault
  2016-09-19 18:29:59.691542 |     Details: Request Failed: internal server error while processing your request.
  2016-09-19 18:29:59.691554 |     

  Link to full test run:
  http://logs.openstack.org/58/303658/6/check/gate-tempest-dsvm-neutron-full-ubuntu-xenial/b0f8c3c/console.html

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1625316/+subscriptions