yahoo-eng-team team mailing list archive

[Phil Day <1319263@xxxxxxxxxxxxxxxxxx>]

Marking as Invalid since this is a MySQL mis-configuration error by the
user rather than a Nova bug

** Changed in: nova
       Status: Incomplete => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1319263

Title:
  ICE-HOUSE-GA:Nova conductor and Nova scheduler not stable when 200
  compute connected to the  controller.

Status in OpenStack Compute (Nova):
  Invalid

Bug description:
  Unable to boot more than ~117 VMs.
  The VMs remain in Build/Scheduling state and do not goto active state.

  | f367e216-decf-43c0-a5fe-26af0796235b | vm_one1-f367e216-decf-43c0-a5fe-26af0796235b | BUILD  | scheduling | NOSTATE     |          |
  | f374c766-c715-4d39-97da-5baa47bd16b5 | vm_one1-f374c766-c715-4d39-97da-5baa47bd16b5 | BUILD  | scheduling | NOSTATE     |          |
  | f391ce75-20fc-4bc1-93b0-0ff716eff044 | vm_one1-f391ce75-20fc-4bc1-93b0-0ff716eff044 | BUILD  | scheduling | NOSTATE     |          |
  | f3e06663-b7b8-4933-a499-88d64dede80a | vm_one1-f3e06663-b7b8-4933-a499-88d64dede80a | BUILD  | scheduling | NOSTATE     |          |
  | f3fb6f81-c1b7-4f8a-a27a-062a5af775de | vm_one1-f3fb6f81-c1b7-4f8a-a27a-062a5af775de | BUILD  | scheduling | NOSTATE     |          |
  | f442ea70-fd60-42b1-aa61-782a1c5a21d9 | vm_one1-f442ea70-fd60-42b1-aa61-782a1c5a21d9 | BUILD  | scheduling | NOSTATE     |          |
  | f4a2adae-fa84-4004-bfb8-40664a1fe29c | vm_one1-f4a2adae-fa84-4004-bfb8-40664a1fe29c | BUILD  | scheduling | NOSTATE     |          |

  
  Here is what I am doing:
  I am creating VMs in a batch of 5 and providing a delay of 90 secs for each of the batch operation.

  However I am seeing this issue only when I connect around 200 compute
  nodes to controller. If I reduce the number of Compute nodes to around
  80 I m able to spawn more than 1000 VMs.

  So on the outset it looks like, the number of compute nodes connected
  to controller is playing a role in how many VMs can booted.

  Also pls. note that all the VMs being booted are part of single
  tenant.

  Below are the details of the setup on which the issue was observed:
  1. Server Config: 32CPU,32GB RAM,Ubuntu 12.04 LTS Server.
  2. Number of Compute nodes connected to Controller: 200.
  Following error msgs are being observed in the log files:

  found that inside the log says Operational error /Too many
  connections.

  nova.servicegroup.drivers.db [-] model server went away”
  “2014-05-13 18:22:13.035 16245 ERROR nova.servicegroup.drivers.db [-] Recovered model server connection!”

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1319263/+subscriptions