← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1642537] Re: finish_resize fails with DBDeadlock on migrations table

 

Reviewed:  https://review.openstack.org/633075
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=74f9bba9c7ac27df8f73d11fc317649ae22040fb
Submitter: Zuul
Branch:    master

commit 74f9bba9c7ac27df8f73d11fc317649ae22040fb
Author: Matt Riedemann <mriedem.os@xxxxxxxxx>
Date:   Thu Jan 24 17:11:06 2019 -0500

    Add retry_on_deadlock to migration_update DB API
    
    Lots of different things can be updating the same migration
    record at the same time (different computes, the API, etc)
    and we see DBDeadlock errors on migration_update at times
    (and operators that do a lot of migrations have mentioned it
    also) so this change simply adds the retry_on_deadlock decorator
    to the migration_update DB API method.
    
    Change-Id: I98bbe96e4be5326e18ef2c2ac50c0d24993d52ec
    Closes-Bug: #1642537


** Changed in: nova
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1642537

Title:
  finish_resize fails with DBDeadlock on migrations table

Status in OpenStack Compute (nova):
  Fix Released

Bug description:
  http://logs.openstack.org/00/352200/14/check/gate-tempest-dsvm-
  neutron-linuxbridge-ubuntu-xenial/6ba61d3/console.html

  
  2016-11-17 05:06:33.890498 | Captured traceback:
  2016-11-17 05:06:33.890507 | ~~~~~~~~~~~~~~~~~~~
  2016-11-17 05:06:33.890534 |     Traceback (most recent call last):
  2016-11-17 05:06:33.890566 |       File "tempest/api/compute/servers/test_server_actions.py", line 289, in test_resize_server_confirm
  2016-11-17 05:06:33.890586 |         self._test_resize_server_confirm(stop=False)
  2016-11-17 05:06:33.890613 |       File "tempest/api/compute/servers/test_server_actions.py", line 271, in _test_resize_server_confirm
  2016-11-17 05:06:33.890624 |         'VERIFY_RESIZE')
  2016-11-17 05:06:33.890644 |       File "tempest/common/waiters.py", line 75, in wait_for_server_status
  2016-11-17 05:06:33.890655 |         server_id=server_id)
  2016-11-17 05:06:33.890686 |     tempest.exceptions.BuildErrorException: Server 00876f9f-2f30-4507-93c0-f0f5a1699565 failed to build and is in ERROR status
  2016-11-17 05:06:33.890761 |     Details: {u'code': 500, u'message': u"Remote error: DBDeadlock (pymysql.err.InternalError) (1213, u'Deadlock found when trying to get lock; try restarting transaction') [SQL: u'UPDATE migrations SET updated_at=%(updated_at)s, status=%(status)s WHERE migrations.id = %(migrations_id)s'] [parame", u'created': u'2016-11-17T04:43:56Z'}
  2016-11-17 05:06:33.890767 |

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1642537/+subscriptions


References