yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1724138] Re: InvalidRequestError in networking-midonet UTs

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: OpenStack Infra <1724138@xxxxxxxxxxxxxxxxxx>
Date: Sat, 21 Oct 2017 00:55:49 -0000
Reply-to: Bug 1724138 <1724138@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Reviewed:  https://review.openstack.org/512564
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=2a7cf9a97476ab1e56c5b3724b0d60cc29e7db1f
Submitter: Zuul
Branch:    master

commit 2a7cf9a97476ab1e56c5b3724b0d60cc29e7db1f
Author: YAMAMOTO Takashi <yamamoto@xxxxxxxxxxxx>
Date:   Tue Oct 17 18:35:04 2017 +0900

    create_security_group: Expunge an object selectively
    
    This expunge_all() can detach unrelated DB objects.  Especially
    it can have wider effects with surrounding transactions, used by
    some of service plugins like networking-midonet L3 plugin.
    
    The problem was exposed by the recent OVO change [1] on
    networking-midonet gate jobs.
    
    [1] I5dcf9dc358c1122b2b22a6c4f40ae0b170e2003c
    
    Closes-Bug: #1724138
    Change-Id: Ib2227e332c52d2f7225c41f57108c38641348183


** Changed in: neutron
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1724138

Title:
  InvalidRequestError in networking-midonet UTs

Status in networking-midonet:
  In Progress
Status in neutron:
  Fix Released

Bug description:
  eg. http://logs.openstack.org/95/490295/2/check/openstack-tox-
  py27/6dc90f1/job-output.txt.gz

  2017-10-17 04:45:52.592296 | ubuntu-xenial | add_router_interface failed: No details.
  2017-10-17 04:45:52.592360 | ubuntu-xenial | Traceback (most recent call last):
  2017-10-17 04:45:52.592415 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/api/v2/resource.py", line 98, in resource
  2017-10-17 04:45:52.592442 | ubuntu-xenial |     result = method(request=request, **args)
  2017-10-17 04:45:52.592485 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 92, in wrapped
  2017-10-17 04:45:52.592509 | ubuntu-xenial |     setattr(e, '_RETRY_EXCEEDED', True)
  2017-10-17 04:45:52.592573 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2017-10-17 04:45:52.592591 | ubuntu-xenial |     self.force_reraise()
  2017-10-17 04:45:52.592692 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2017-10-17 04:45:52.592746 | ubuntu-xenial |     six.reraise(self.type_, self.value, self.tb)
  2017-10-17 04:45:52.592835 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 88, in wrapped
  2017-10-17 04:45:52.592868 | ubuntu-xenial |     return f(*args, **kwargs)
  2017-10-17 04:45:52.592932 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_db/api.py", line 150, in wrapper
  2017-10-17 04:45:52.592967 | ubuntu-xenial |     ectxt.value = e.inner_exc
  2017-10-17 04:45:52.593087 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2017-10-17 04:45:52.593121 | ubuntu-xenial |     self.force_reraise()
  2017-10-17 04:45:52.593186 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2017-10-17 04:45:52.593213 | ubuntu-xenial |     six.reraise(self.type_, self.value, self.tb)
  2017-10-17 04:45:52.593273 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_db/api.py", line 138, in wrapper
  2017-10-17 04:45:52.593320 | ubuntu-xenial |     return f(*args, **kwargs)
  2017-10-17 04:45:52.593398 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 127, in wrapped
  2017-10-17 04:45:52.593465 | ubuntu-xenial |     LOG.debug("Retry wrapper got retriable exception: %s", e)
  2017-10-17 04:45:52.593588 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2017-10-17 04:45:52.593619 | ubuntu-xenial |     self.force_reraise()
  2017-10-17 04:45:52.593731 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2017-10-17 04:45:52.595972 | ubuntu-xenial |     six.reraise(self.type_, self.value, self.tb)
  2017-10-17 04:45:52.596076 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 123, in wrapped
  2017-10-17 04:45:52.596112 | ubuntu-xenial |     return f(*dup_args, **dup_kwargs)
  2017-10-17 04:45:52.596184 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/api/v2/base.py", line 257, in _handle_action
  2017-10-17 04:45:52.596248 | ubuntu-xenial |     ret_value = getattr(self._plugin, name)(*arg_list, **kwargs)
  2017-10-17 04:45:52.596356 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_log/helpers.py", line 67, in wrapper
  2017-10-17 04:45:52.596393 | ubuntu-xenial |     return method(*args, **kwargs)
  2017-10-17 04:45:52.596467 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 162, in wrapped
  2017-10-17 04:45:52.596516 | ubuntu-xenial |     return method(*args, **kwargs)
  2017-10-17 04:45:52.596588 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 92, in wrapped
  2017-10-17 04:45:52.596617 | ubuntu-xenial |     setattr(e, '_RETRY_EXCEEDED', True)
  2017-10-17 04:45:52.596694 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2017-10-17 04:45:52.596733 | ubuntu-xenial |     self.force_reraise()
  2017-10-17 04:45:52.596861 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2017-10-17 04:45:52.596910 | ubuntu-xenial |     six.reraise(self.type_, self.value, self.tb)
  2017-10-17 04:45:52.596955 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 88, in wrapped
  2017-10-17 04:45:52.597032 | ubuntu-xenial |     return f(*args, **kwargs)
  2017-10-17 04:45:52.597115 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_db/api.py", line 150, in wrapper
  2017-10-17 04:45:52.597183 | ubuntu-xenial |     ectxt.value = e.inner_exc
  2017-10-17 04:45:52.597353 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2017-10-17 04:45:52.597388 | ubuntu-xenial |     self.force_reraise()
  2017-10-17 04:45:52.597451 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2017-10-17 04:45:52.597477 | ubuntu-xenial |     six.reraise(self.type_, self.value, self.tb)
  2017-10-17 04:45:52.597533 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_db/api.py", line 138, in wrapper
  2017-10-17 04:45:52.597563 | ubuntu-xenial |     return f(*args, **kwargs)
  2017-10-17 04:45:52.597625 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 127, in wrapped
  2017-10-17 04:45:52.597678 | ubuntu-xenial |     LOG.debug("Retry wrapper got retriable exception: %s", e)
  2017-10-17 04:45:52.597744 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2017-10-17 04:45:52.597762 | ubuntu-xenial |     self.force_reraise()
  2017-10-17 04:45:52.597864 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
  2017-10-17 04:45:52.597920 | ubuntu-xenial |     six.reraise(self.type_, self.value, self.tb)
  2017-10-17 04:45:52.597982 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 123, in wrapped
  2017-10-17 04:45:52.598008 | ubuntu-xenial |     return f(*dup_args, **dup_kwargs)
  2017-10-17 04:45:52.598045 | ubuntu-xenial |   File "midonet/neutron/services/l3/l3_midonet.py", line 181, in add_router_interface
  2017-10-17 04:45:52.598369 | ubuntu-xenial |     context, router_id, interface_info)
  2017-10-17 04:45:52.598446 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/l3_db.py", line 1874, in add_router_interface
  2017-10-17 04:45:52.598487 | ubuntu-xenial |     context, router_id, interface_info)
  2017-10-17 04:45:52.598539 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/api.py", line 162, in wrapped
  2017-10-17 04:45:52.598562 | ubuntu-xenial |     return method(*args, **kwargs)
  2017-10-17 04:45:52.598628 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/neutron/neutron/db/l3_db.py", line 896, in add_router_interface
  2017-10-17 04:45:52.598673 | ubuntu-xenial |     context.session.refresh(router)
  2017-10-17 04:45:52.598759 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 1450, in refresh
  2017-10-17 04:45:52.598788 | ubuntu-xenial |     self._expire_state(state, attribute_names)
  2017-10-17 04:45:52.598859 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 1536, in _expire_state
  2017-10-17 04:45:52.598904 | ubuntu-xenial |     self._validate_persistent(state)
  2017-10-17 04:45:52.599023 | ubuntu-xenial |   File "/home/zuul/src/git.openstack.org/openstack/networking-midonet/.tox/py27/local/lib/python2.7/site-packages/sqlalchemy/orm/session.py", line 1976, in _validate_persistent
  2017-10-17 04:45:52.599071 | ubuntu-xenial |     state_str(state))
  2017-10-17 04:45:52.599150 | ubuntu-xenial | InvalidRequestError: Instance '<Router at 0x7f04a493aed0>' is not persistent within this Session
  2017-10-17 04:45:52.607480 | ubuntu-xenial | No sqlalchemy event for resource network found
  2017-10-17 04:45:52.607581 | ubuntu-xenial | No sqlalchemy event for resource subnetpool found
  2017-10-17 04:45:52.607688 | ubuntu-xenial | No sqlalchemy event for resource security_group_rule found
  2017-10-17 04:45:52.607779 | ubuntu-xenial | No sqlalchemy event for resource security_group found
  2017-10-17 04:45:52.607862 | ubuntu-xenial | No sqlalchemy event for resource port found
  2017-10-17 04:45:52.607948 | ubuntu-xenial | No sqlalchemy event for resource subnet found
  2017-10-17 04:45:52.611525 | ubuntu-xenial | {3}

To manage notifications about this bug go to:
https://bugs.launchpad.net/networking-midonet/+bug/1724138/+subscriptions