openstack team mailing list archive

[<Eric_E_Smith@xxxxxxxx>]

You might take a look at iptraf during a slow deployment to determine if the utilization on a particular interface is high.

-----Original Message-----
From: Openstack [mailto:openstack-bounces+eric_e_smith=dell.com@xxxxxxxxxxxxxxxxxxx] On Behalf Of Steve Heistand
Sent: Wednesday, May 01, 2013 12:43 PM
To: openstack@xxxxxxxxxxxxxxxxxxx
Subject: Re: [Openstack] launching multiple VMs takes very long time

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

ok a followup to this.

its not any sort of disk access issue. I created a new disk to hold the glance directory and running atop while launching shows all the activity on the original root drive nothing using glance.
Normally at idle the root drive does get heavily used by something, mostly keystone and rabbit so atop show that partition as busy. When launching a VM it doesnt seem to get more busy though. (maybe an LVM / is a bad idea)

Ive also tried launching tiny (ie cirros) images and they too take ages to boot into tiny flavors.

The really really weird part is that I ran an experiment of only launching 1 vm at a time. the time this takes grows each time I launch one.
1st vm < 2 minutes
2nd 2.5m
3rd 4m
4th 8m
5th 10m
6th 12m
...

there may be some network issues going on here, trying to shove some amount of data bigger then a few Gig seems to start slowing things down.

s



On 04/30/2013 11:42 AM, Steve Heistand wrote:
> if I launch one vm at a time its doesnt very long to start up the 
> instance. maybe a minute. if I launch 4 instances (of the same 
> snapshot as before) it takes 30 minutes.
> 
> they are all launching to different compute nodes, the controllers are 
> all multicore, I dont see any processes on the compute nodes taking 
> much cpu power, the controller has a keystone process mostly sucking 
> up 1 core, loads and loads of beam.smp from rabbitmq but none are really taking any cpu time.
> 
> the glance image storage is on the controller node, the snapshots are 2-3G in size.
> 
> where should I start looking to find out why things are so slow?
> 
> thanks
> 
> s
> 

- --
************************************************************************
 Steve Heistand                          NASA Ames Research Center
 email: steve.heistand@xxxxxxxx          Steve Heistand/Mail Stop 258-6
 ph: (650) 604-4369                      Bldg. 258, Rm. 232-5
 Scientific & HPC Application            P.O. Box 1
 Development/Optimization                Moffett Field, CA 94035-0001
************************************************************************
 "Any opinions expressed are those of our alien overlords, not my own."

# For Remedy                        #
#Action: Resolve                    #	
#Resolution: Resolved               #
#Reason: No Further Action Required #
#Tier1:	User Code                   #
#Tier2:	Other                       #
#Tier3:	Assistance                  #
#Notification: None                 #
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v2.0.14 (GNU/Linux)

iEYEARECAAYFAlGBVD4ACgkQoBCTJSAkVrErjACfetTt4wDzuh9Pq8AuI+iGjXFB
toMAmgKR96PJ89edpdHnRyjFyqN25g6k
=/+lx
-----END PGP SIGNATURE-----

_______________________________________________
Mailing list: https://launchpad.net/~openstack
Post to     : openstack@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp