yahoo-eng-team team mailing list archive

[Rui Chen <chenrui.momo@xxxxxxxxx>]

Public bug reported:

1. code base

$ git log -1
commit b492942744e09276e3ba4dcf0196143c521a1662
Merge: 920abc9 9706454
Author: Jenkins <jenkins@xxxxxxxxxxxxxxxxxxxx>
Date:   Thu Sep 3 00:05:04 2015 +0000

    Merge "Fix bodies on consolidate-console-api"

2. Reproduce steps:

The issue happen on VMware driver, think about the following case:
* 200 active instances run in one nova-compute host that map to one vCenter Cluster, batch delete all instances, all of them are in "deleting" task_state.
* nova-compute process stop and restart when all instances are in "deleting" task_state.
* nova-compute start to init 200 deleting instances one by one. The workflow of VMware driver is power-off instance, then wait task finish, then delete the instance.
* After all the deleting instances are handled, nova-compute is set to "up" state, continue to work.

step 3 will spend lots of time on serial init_instance. In my
performance test environment, the nova-compute spend about 15 minutes to
finish init_instance.

In other drivers, like: libvirt, nova-compute manage less instances than
VMware driver (maybe less than 50 instances), so these drivers have less
chance to face the issue.

** Affects: nova
     Importance: Undecided
     Assignee: Rui Chen (kiwik-chenrui)
         Status: In Progress

** Changed in: nova
     Assignee: (unassigned) => Rui Chen (kiwik-chenrui)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1496334

Title:
  Nova-compute launch slowly because lots of instances is init one by
  one

Status in OpenStack Compute (nova):
  In Progress

Bug description:
  1. code base

  $ git log -1
  commit b492942744e09276e3ba4dcf0196143c521a1662
  Merge: 920abc9 9706454
  Author: Jenkins <jenkins@xxxxxxxxxxxxxxxxxxxx>
  Date:   Thu Sep 3 00:05:04 2015 +0000

      Merge "Fix bodies on consolidate-console-api"

  2. Reproduce steps:

  The issue happen on VMware driver, think about the following case:
  * 200 active instances run in one nova-compute host that map to one vCenter Cluster, batch delete all instances, all of them are in "deleting" task_state.
  * nova-compute process stop and restart when all instances are in "deleting" task_state.
  * nova-compute start to init 200 deleting instances one by one. The workflow of VMware driver is power-off instance, then wait task finish, then delete the instance.
  * After all the deleting instances are handled, nova-compute is set to "up" state, continue to work.

  step 3 will spend lots of time on serial init_instance. In my
  performance test environment, the nova-compute spend about 15 minutes
  to finish init_instance.

  In other drivers, like: libvirt, nova-compute manage less instances
  than VMware driver (maybe less than 50 instances), so these drivers
  have less chance to face the issue.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1496334/+subscriptions