yahoo-eng-team team mailing list archive

[Oleg Bondarev <obondarev@xxxxxxxxxxxx>]

Public bug reported:

resource_versions were included into agent state reports recently to support rolling upgrades (commit 97a272a892fcf488949eeec4959156618caccae8) 
The downside is that it brought additional processing when handling state reports on server side: update of local resources versions cache and more seriously rpc casts to all other servers to do the same. 

All this led to a visible performance degradation at scale with hundreds
of agents constantly sending reports. Under load (rally test) agents may
start "blinking" which makes cluster very unstable.

Need to optimize agents notifications about resource_versions.

** Affects: neutron
     Importance: High
     Assignee: Oleg Bondarev (obondarev)
         Status: In Progress

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1567497

Title:
  resource_versions in agents state reports led to performance
  degradation

Status in neutron:
  In Progress

Bug description:
  resource_versions were included into agent state reports recently to support rolling upgrades (commit 97a272a892fcf488949eeec4959156618caccae8) 
  The downside is that it brought additional processing when handling state reports on server side: update of local resources versions cache and more seriously rpc casts to all other servers to do the same. 

  All this led to a visible performance degradation at scale with
  hundreds of agents constantly sending reports. Under load (rally test)
  agents may start "blinking" which makes cluster very unstable.

  Need to optimize agents notifications about resource_versions.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1567497/+subscriptions