← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1447732] [NEW] Cells: _heal_instances periodic task can lead to too much memory usage

 

Public bug reported:

During testing we found that if 220,000 instances match the updated_at
criteria in _heal_instances they are all pulled from the db which can
lead to huge memory usage and the oom killer stepping in.  The large
number of updated_at instances could happen organically, but in our case
was triggered by the _run_pending_deletes compute periodic task updating
a large number of instances.

** Affects: nova
     Importance: Undecided
     Assignee: Andrew Laski (alaski)
         Status: In Progress

** Changed in: nova
     Assignee: (unassigned) => Andrew Laski (alaski)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1447732

Title:
  Cells: _heal_instances periodic task can lead to too much memory usage

Status in OpenStack Compute (Nova):
  In Progress

Bug description:
  During testing we found that if 220,000 instances match the updated_at
  criteria in _heal_instances they are all pulled from the db which can
  lead to huge memory usage and the oom killer stepping in.  The large
  number of updated_at instances could happen organically, but in our
  case was triggered by the _run_pending_deletes compute periodic task
  updating a large number of instances.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1447732/+subscriptions


Follow ups

References