yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #77729
[Bug 1642537] Re: finish_resize fails with DBDeadlock on migrations table
Reviewed: https://review.openstack.org/633075
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=74f9bba9c7ac27df8f73d11fc317649ae22040fb
Submitter: Zuul
Branch: master
commit 74f9bba9c7ac27df8f73d11fc317649ae22040fb
Author: Matt Riedemann <mriedem.os@xxxxxxxxx>
Date: Thu Jan 24 17:11:06 2019 -0500
Add retry_on_deadlock to migration_update DB API
Lots of different things can be updating the same migration
record at the same time (different computes, the API, etc)
and we see DBDeadlock errors on migration_update at times
(and operators that do a lot of migrations have mentioned it
also) so this change simply adds the retry_on_deadlock decorator
to the migration_update DB API method.
Change-Id: I98bbe96e4be5326e18ef2c2ac50c0d24993d52ec
Closes-Bug: #1642537
** Changed in: nova
Status: In Progress => Fix Released
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1642537
Title:
finish_resize fails with DBDeadlock on migrations table
Status in OpenStack Compute (nova):
Fix Released
Bug description:
http://logs.openstack.org/00/352200/14/check/gate-tempest-dsvm-
neutron-linuxbridge-ubuntu-xenial/6ba61d3/console.html
2016-11-17 05:06:33.890498 | Captured traceback:
2016-11-17 05:06:33.890507 | ~~~~~~~~~~~~~~~~~~~
2016-11-17 05:06:33.890534 | Traceback (most recent call last):
2016-11-17 05:06:33.890566 | File "tempest/api/compute/servers/test_server_actions.py", line 289, in test_resize_server_confirm
2016-11-17 05:06:33.890586 | self._test_resize_server_confirm(stop=False)
2016-11-17 05:06:33.890613 | File "tempest/api/compute/servers/test_server_actions.py", line 271, in _test_resize_server_confirm
2016-11-17 05:06:33.890624 | 'VERIFY_RESIZE')
2016-11-17 05:06:33.890644 | File "tempest/common/waiters.py", line 75, in wait_for_server_status
2016-11-17 05:06:33.890655 | server_id=server_id)
2016-11-17 05:06:33.890686 | tempest.exceptions.BuildErrorException: Server 00876f9f-2f30-4507-93c0-f0f5a1699565 failed to build and is in ERROR status
2016-11-17 05:06:33.890761 | Details: {u'code': 500, u'message': u"Remote error: DBDeadlock (pymysql.err.InternalError) (1213, u'Deadlock found when trying to get lock; try restarting transaction') [SQL: u'UPDATE migrations SET updated_at=%(updated_at)s, status=%(status)s WHERE migrations.id = %(migrations_id)s'] [parame", u'created': u'2016-11-17T04:43:56Z'}
2016-11-17 05:06:33.890767 |
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1642537/+subscriptions
References