← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1560724] Re: Deadlock errors when updating agents table

 

Reviewed:  https://review.openstack.org/296100
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=d5e4013556c7144d347ece267c4bd3c8dc87b24f
Submitter: Jenkins
Branch:    master

commit d5e4013556c7144d347ece267c4bd3c8dc87b24f
Author: Eugene Nikanorov <enikanorov@xxxxxxxxxxxx>
Date:   Mon Mar 21 20:05:47 2016 -0700

    Retry updating agents table in case of deadlock
    
    Updating agents table is contantious operation which
    can fail often if mysql backend is in multimaster mode.
    This could lead to agents flapping and various issues
    such as sporadic reschedluing, port binding failures, etc.
    
    Change-Id: Ief392f9a09d86c185dc086055d2cbc1891ff1d7f
    Closes-Bug: #1560724


** Changed in: neutron
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1560724

Title:
  Deadlock errors when updating agents table

Status in neutron:
  Fix Released

Bug description:
  This well-known error may appear when updating agents table with heartbeat information.
  The reason for this error is mysql backend configured as multi-master cluster.

  Usual solution is to apply retries here, which was not done for this
  particular case.

  As a result of this deadlock various side effects could arise such as
  agents become dead, port binding failures or resource rescheduling.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1560724/+subscriptions


References