yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1009026] Re: When launching 50 vms some of them fail to start vm_state=error task_state=networking.

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: "Davanum Srinivas \(DIMS\)" <davanum@xxxxxxxxx>
Date: Mon, 18 Mar 2013 11:33:03 -0000
Reply-to: Bug 1009026 <1009026@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
This bug lacks the necessary information to effectively reproduce and
fix it, therefore it has been closed. Feel free to reopen the bug by
providing the requested information and set the bug status back to
''New''.

** Changed in: nova
       Status: Incomplete => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1009026

Title:
  When launching 50 vms some of them fail to start vm_state=error
  task_state=networking.

Status in OpenStack Compute (Nova):
  Invalid

Bug description:
  Scenario:
  Launching 50 vms via the dashboard. 
  Result:
  Some of them (1-4) fail to start.

  #nova list
  +--------------------------------------+------------+--------+-----------------------+
  |                  ID                  |    Name    | Status |        Networks       |
  +--------------------------------------+------------+--------+-----------------------+
  | 021df24c-e7e6-455f-a483-31b25186d204 | 50 servers | ACTIVE | davidnet=192.168.1.8  |
  | 02cd8a10-202f-4bb5-b9be-c29e26323e21 | 50 servers | ACTIVE | davidnet=192.168.1.73 |
  | 039d03fb-2e2d-477a-9d20-d0b940d13297 | 50 servers | ERROR  | davidnet=192.168.1.43 |
  | 0814bea3-a3a8-49a0-8dbe-861c9b8c3145 | 50 servers | ACTIVE | davidnet=192.168.1.82 |
  | 1df60c5f-ac7d-42a0-bac2-c24c1bf50cdf | 50 servers | ACTIVE | davidnet=192.168.1.71 |
  | 22c32540-54bd-4ebc-9a63-3dc9fba4a23b | 50 servers | ACTIVE | davidnet=192.168.1.38 |
  | 26983fb0-e0fd-434a-be08-3fd223d2e286 | 50 servers | ACTIVE | davidnet=192.168.1.97 |
  | 29de3f69-71dd-4c50-bd59-81e683b2387f | 50 servers | ACTIVE | davidnet=192.168.1.70 |
  | 2dcda45f-845e-4cd6-9433-be4b1684c1b9 | 50 servers | ACTIVE | davidnet=192.168.1.84 |
  | 317f3c17-b580-4c36-b4a5-fc56a57d2111 | 50 servers | ACTIVE | davidnet=192.168.1.6  |
  | 32c02027-e583-4319-a00b-94f2082f71a2 | 50 servers | ACTIVE | davidnet=192.168.1.72 |
  | 39e704c0-69fc-4b36-aa3f-e0ef7434d544 | 50 servers | ACTIVE | davidnet=192.168.1.85 |
  | 3fe4d925-754d-4464-8e40-0797a2d7946c | 50 servers | ACTIVE | davidnet=192.168.1.88 |
  | 48e0e497-db7a-422e-9aae-8b0c3716558f | 50 servers | ACTIVE | davidnet=192.168.1.79 |
  | 49f70fad-ae8f-48a6-9929-2e08b6d95521 | 50 servers | ACTIVE | davidnet=192.168.1.7  |
  | 51fda92e-02de-4ce6-af13-8b3b6b83ba61 | 50 servers | ACTIVE | davidnet=192.168.1.34 |
  | 55619887-d984-44df-bf4b-22a11bd6f277 | 50 servers | ACTIVE | davidnet=192.168.1.41 |
  | 58e1b7bd-2fbe-45f8-81ff-e53aff1079d5 | 50 servers | ACTIVE | davidnet=192.168.1.74 |
  | 64ec328d-1a70-490f-a360-ece95937b736 | 50 servers | ACTIVE | davidnet=192.168.1.69 |
  | 68a24c59-b6fa-47b1-8ea6-3d7515b4cfdc | 50 servers | ACTIVE | davidnet=192.168.1.96 |
  | 69c4aa70-ec2c-4977-bf5c-e3a14a8db462 | 50 servers | ACTIVE | davidnet=192.168.1.92 |
  | 6fb1f830-5b81-40bc-a650-7a71a7b17c5d | 50 servers | ACTIVE | davidnet=192.168.1.33 |
  | 7746f9cd-d64b-4467-b1bd-3d47e055603b | 50 servers | ACTIVE | davidnet=192.168.1.89 |
  | 7830fc35-de94-417b-a456-ec1d546c94c3 | 50 servers | ERROR  | davidnet=192.168.1.36 |
  | 80f8afe7-7481-4d62-9a87-7054064c619f | 50 servers | ACTIVE | davidnet=192.168.1.98 |
  | 8a3065b0-0ff6-40ac-b4ef-a8126bd34b68 | 50 servers | ACTIVE | davidnet=192.168.1.90 |
  | 8b28bb5a-e762-4dc4-80b4-f06605624357 | 50 servers | ACTIVE | davidnet=192.168.1.77 |
  | 92fe4acd-1bfc-44c1-9f9e-f98130165d72 | 50 servers | ACTIVE | davidnet=192.168.1.35 |
  | 94d87ade-9130-421e-b790-4e7084b5c123 | 50 servers | ACTIVE | davidnet=192.168.1.80 |
  | 960760af-d14e-4481-af4c-568946d72972 | 50 servers | ACTIVE | davidnet=192.168.1.94 |
  | a428f259-f25f-4448-bd3b-ed3c5d065c8d | 50 servers | ACTIVE | davidnet=192.168.1.78 |
  | a53cead8-1856-4fb9-8360-bd457c4a8934 | 50 servers | ACTIVE | davidnet=192.168.1.5  |
  | b66d06df-9988-4c97-9a59-028cfba8d801 | 50 servers | ACTIVE | davidnet=192.168.1.42 |
  | bc021b6e-16c0-4340-aaf8-be9ffb9a2efe | 50 servers | ACTIVE | davidnet=192.168.1.93 |
  | bd656521-d9c7-4b96-affb-10078e1f4142 | 50 servers | ACTIVE | davidnet=192.168.1.87 |
  | be96f278-8ea6-4f3e-a75d-a4c8639269ab | 50 servers | ERROR  | davidnet=192.168.1.40 |
  | c0e96cf4-c985-4216-943c-e703967b021f | 50 servers | ACTIVE | davidnet=192.168.1.31 |
  | c1e22c4d-d914-4528-80ba-18a7c255726e | 50 servers | ACTIVE | davidnet=192.168.1.76 |
  | c76b7e30-7dd9-4798-9dc8-9a3b7a934959 | 50 servers | ACTIVE | davidnet=192.168.1.81 |
  | c7f55b54-4bbf-44e9-90cf-1020d6b07cda | 50 servers | ACTIVE | davidnet=192.168.1.29 |
  | cb6d3398-082f-4fba-a748-413590a2fd1e | 50 servers | ACTIVE | davidnet=192.168.1.39 |
  | e1ecb4dc-e7fb-4362-9f6e-54f2e935b4d1 | 50 servers | ACTIVE | davidnet=192.168.1.9  |
  | eefabcaa-6440-4990-b1f0-30e33f54f3de | 50 servers | ACTIVE | davidnet=192.168.1.32 |
  | ef8d38f2-ff64-48b1-81f9-cba50a043203 | 50 servers | ACTIVE | davidnet=192.168.1.86 |
  | efcd8d67-2b55-4d0c-a96d-0396c1d629d8 | 50 servers | ACTIVE | davidnet=192.168.1.37 |
  | f0a107ff-01af-42b7-b978-ed35288dd6bf | 50 servers | ACTIVE | davidnet=192.168.1.95 |
  | f1eb70ab-05ba-4a5d-b0d1-3d5110bbe8bf | 50 servers | ACTIVE | davidnet=192.168.1.91 |
  | f6fba6ad-f87e-4fad-a417-95551f1791be | 50 servers | ACTIVE | davidnet=192.168.1.75 |
  | fb14eee2-41d5-44ca-9989-b48a7ec1e754 | 50 servers | ACTIVE | davidnet=192.168.1.30 |
  | fc7a83e5-1158-4123-be1a-f440be381317 | 50 servers | ACTIVE | davidnet=192.168.1.83 |
  +--------------------------------------+------------+--------+-----------------------+

  
  The only clue i find in logs:
  2012-06-05 16:44:49 DEBUG nova.api.openstack.common [req-a35a8286-5d73-4405-afd4-738b809262fa 2f4edfa99cab42de92eacda360043116 7eed65dd55474b9e94cd412d9f66b406] Generated ERROR from vm_state=error task_state=networking. from (pid=8447) s
  tatus_from_state /usr/lib/python2.6/site-packages/nova/api/openstack/common.py:96

  (Reproduced several times 100% reproducible)
  Attached logs (verbose):
  network.log 
  api.log 
  compute.log 
  scheduler.log

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1009026/+subscriptions