← Back to team overview

openstack team mailing list archive

heterogeneous instance types

 

I've uploaded a family of related of blueprints that the USC-ISI team is hoping to integrate into the Diablo release:

https://blueprints.launchpad.net/nova/+spec/heterogeneous-instance-types
http://wiki.openstack.org/HeterogeneousInstanceTypes

They could use some reviews in advance of the design summit.  At our internal sprint review this week, we were able to launch in a multi-node configuration a 64-core 128GB virtual machine on our SGI UV100 (check out /proc/cpuinfo and /proc/meminfo below :-), a cg1.4xlarge with Nvidia S2050 GPU attached (currently using the gVirtuS driver), and a Tilera TileEmpower TilePro 64-core (8x8) system.  

We're going to start posting some of our results out on to the openstack wiki, but hopefully for Diablo, we will no longer need a homogeneous cloud infrastructure.

Brian

---

bespin:/tmp/openstack-demo # more nova/bin/nova.conf 
--verbose
--nodaemon
--dhcpbridge_flagfile=/tmp/openstack-demo/nova/bin/nova.conf
--dhcpbridge=/tmp/openstack-demo/nova/bin/nova-dhcpbridge
--cc_host=10.9.1.1
--s3_host=10.9.1.1
--ec2_url=http://10.9.1.1:8773/services/Cloud
--rabbit_host=10.9.1.1
--sql_connection=mysql://root:nova@10.9.1.1/nova
--auth_driver=nova.auth.dbdriver.DbDriver
--network_manager=nova.network.manager.FlatDHCPManager
--fixed_range=10.9.1.0/25
--network_size=128
--FAKE_subdomain=ec2
--libvirt_type=kvm
--flat_network_dhcp_start=10.9.1.2
--images_path=/home/images
--scheduler_driver=nova.scheduler.arch.ArchitectureScheduler
--quota_cores=1024
--quota_gigabytes=1000
--connection_type=libvirt
--cpu_arch=x86_64
--xpu_arch=

---

bespin:/home/dkang # euca-describe-instances 
RESERVATION	r-rkf0hucv	admin	default
INSTANCE	i-00000002	ami-76642884	10.9.1.3	10.9.1.3	running 	u1 (admin, uv) 	0 	m1.large 	2011-03-30T15:02:43Z 	nova
RESERVATION	r-zzp3rfgs	admin	default
INSTANCE	i-00000006	ami-76642884	10.9.1.7	10.9.1.7	running 	mykey (admin, uv) 	0 	sh1.8xlarge 	2011-03-31T20:08:09Z 	nova
RESERVATION	r-512w3my9	admin	default
INSTANCE	i-00000001	ami-76642884	10.9.1.2	10.9.1.2	running 	u1 (admin, uv) 	0 	m1.large 	2011-03-30T15:02:21Z 	nova
RESERVATION	r-8puoktnr	admin	default
INSTANCE	i-00000007	ami-76642884	10.9.1.6	10.9.1.6	running 	mykey (admin, uv) 	0 	sh1.8xlarge 	2011-03-31T20:10:59Z 	nova

bespin:/home/dkang # ssh -i mykey.priv ubuntu@10.9.1.6

Chop wood, carry water.

$ tail -20 /proc/cpuinfo                                                                                

processor	: 63
vendor_id	: GenuineIntel
cpu family	: 6
model		: 2
model name	: QEMU Virtual CPU version 0.12.3
stepping	: 3
cpu MHz		: 1999.866
cache size	: 4096 KB
fpu		: yes
fpu_exception	: yes
cpuid level	: 4
wp		: yes
flags		: fpu de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pse36 clflush mmx fxsr sse sse2 syscall nx lm rep_good pni cx16 popcnt hypervisor lahf_lm
bogomips	: 3999.73
clflush size	: 64
cache_alignment	: 64
address sizes	: 40 bits physical, 48 bits virtual
power management:

$ cat /proc/meminfo                                                                                     
MemTotal:       132294940 kB
MemFree:        129901280 kB
Buffers:             300 kB
Cached:            16424 kB
SwapCached:            0 kB
Active:             4620 kB
Inactive:          13536 kB
Active(anon):       1440 kB
Inactive(anon):        0 kB
Active(file):       3180 kB
Inactive(file):    13536 kB
Unevictable:           0 kB
Mlocked:               0 kB
SwapTotal:             0 kB
SwapFree:              0 kB
Dirty:                 0 kB
Writeback:             0 kB
AnonPages:          1480 kB
Mapped:             1652 kB
Shmem:                 0 kB
Slab:              33188 kB
SReclaimable:       8976 kB
SUnreclaim:        24212 kB
KernelStack:        7056 kB
PageTables:          492 kB
NFS_Unstable:          0 kB
Bounce:                0 kB
WritebackTmp:          0 kB
CommitLimit:    66147468 kB
Committed_AS:       5060 kB
VmallocTotal:   34359738367 kB
VmallocUsed:      222800 kB
VmallocChunk:   34359513032 kB
HardwareCorrupted:     0 kB
HugePages_Total:       0
HugePages_Free:        0
HugePages_Rsvd:        0
HugePages_Surp:        0
Hugepagesize:       2048 kB
DirectMap4k:        8168 kB
DirectMap2M:    134209536 kB

$ uname -a                                                                                              
Linux i-00000007 2.6.35-22-virtual #35-Ubuntu SMP Sat Oct 16 23:19:29 UTC 2010 x86_64 GNU/Linux

---
Brian Schott
USC Information Sciences Institute
http://www.east.isi.edu/~bschott
ph: 703-812-3722 fx: 703-812-3712





Follow ups