yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1490917] Re: create_router regression for some of plugins

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: YAMAMOTO Takashi <yamamoto@xxxxxxxxxxxx>
Date: Tue, 14 Jun 2016 10:55:13 -0000
Reply-to: Bug 1490917 <1490917@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
gate-tempest-dsvm-networking-midonet-ml2 failure with the following backtrace.
i think it can happen with any plugins with a surrounding transaction for create_router.

http://logs.openstack.org/42/328842/2/check/gate-tempest-dsvm-
networking-midonet-
ml2/32b6d98/logs/screen-q-svc.txt.gz?#_2016-06-14_09_02_13_857

2016-06-14 09:02:13.857 12058 ERROR root [req-753083b5-ba59-47d6-a4e8-90df2bcac4bd tempest-RoutersTest-1344545865 -] Original exception being dropped: ['Traceback (most recent call last):\n', '  File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 236, in create_router\n    gw_info, router=router_db)\n', '  File "/opt/stack/new/neutron/neutron/db/l3_gwmode_db.py", line 69, in _update_router_gw_info\n    context, router_id, info, router=router)\n', '  File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 479, in _update_router_gw_info\n    ext_ips)\n', '  File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 449, in _create_gw_port\n    new_network_id, ext_ips)\n', '  File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 350, in _create_router_gw_port\n    context.elevated(), {\'port\': port_data})\n', '  File "/opt/stack/new/neutron/neutron/plugins/common/utils.py", line 164, in create_port\n    return core_plugin.create_port(context, {\'port\': port_data})\n', '  File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1149, in create_port\n    result, mech_context = self._create_port_db(context, port)\n', '  File "/opt/stack/new/neutron/neutron/plugins/ml2/plugin.py", line 1139, in _create_port_db\n    self._setup_dhcp_agent_provisioning_component(context, result)\n', '  File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__\n    self.gen.throw(type, value, traceback)\n', '  File "/opt/stack/new/neutron/neutron/db/api.py", line 67, in exc_to_retry\n    raise db_exc.RetryRequest(e)\n', 'RetryRequest\n']
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource [req-753083b5-ba59-47d6-a4e8-90df2bcac4bd tempest-RoutersTest-1344545865 -] create failed
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource Traceback (most recent call last):
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/resource.py", line 78, in resource
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     result = method(request=request, **args)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 424, in create
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     return self._create(request, body, **kwargs)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 148, in wrapper
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     ectxt.value = e.inner_exc
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 221, in __exit__
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     self.force_reraise()
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 197, in force_reraise
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_db/api.py", line 138, in wrapper
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     return f(*args, **kwargs)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 535, in _create
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     obj = do_create(body)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 517, in do_create
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     request.context, reservation.reservation_id)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 221, in __exit__
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     self.force_reraise()
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 197, in force_reraise
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     six.reraise(self.type_, self.value, self.tb)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/api/v2/base.py", line 510, in do_create
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     return obj_creator(request.context, **kwargs)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_log/helpers.py", line 48, in wrapper
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/networking-midonet/midonet/neutron/services/l3/l3_midonet.py", line 100, in create_router
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     router)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 1642, in create_router
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     router)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/neutron/neutron/db/l3_db.py", line 240, in create_router
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     self.delete_router(context, router_db.id)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/oslo_log/helpers.py", line 48, in wrapper
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     return method(*args, **kwargs)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/opt/stack/new/networking-midonet/midonet/neutron/services/l3/l3_midonet.py", line 147, in delete_router
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     with context.session.begin(subtransactions=True):
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 725, in begin
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     nested=nested)
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 235, in _begin
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     self._assert_active()
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource   File "/usr/local/lib/python2.7/dist-packages/sqlalchemy/orm/session.py", line 218, in _assert_active
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource     "This Session's transaction has been rolled back "
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource InvalidRequestError: This Session's transaction has been rolled back by a nested rollback() call.  To begin a new transaction, issue Session.rollback() first.
2016-06-14 09:02:13.871 12058 ERROR neutron.api.v2.resource

** Changed in: neutron
       Status: Expired => New

** Changed in: neutron
     Assignee: (unassigned) => YAMAMOTO Takashi (yamamoto)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1490917

Title:
  create_router regression for some of plugins

Status in neutron:
  New

Bug description:
  change I5a78d7f32e8ca912016978105221d5f34618af19 broke
  plugins which calls create_router with a surrounding transaction.
  eg. networking-midonet.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1490917/+subscriptions
References

[Bug 1490917] [NEW] create_router regression for some of plugins
From: YAMAMOTO Takashi, 2015-09-01