openstack team mailing list archive

[Jorge Luiz Corrêa <correajl@xxxxxxxxx>]

On Jan 19, 2012, at 6:03 PM, Joe Gordon wrote:

> Hi Jorge,
> 
> I have two questions:
> 
> 1) Has anyone optimized nova to work in a HPC environment like you describe? Such as an intelligent scheduler that will generate VMs that consume x percent of a physical machines resources (so you don't end up with one machine with two separate Hadoop instances competing for resources)?
> 

I don't know about that. It will be a great feature! 

> 2) Why not use something like http://en.wikipedia.org/wiki/TORQUE_Resource_Manager or http://hadoop.apache.org/common/docs/r0.16.4/hod.html?
> 

I'm new with infrastructure for processing applications and I really didn't know these frameworks. Very interesting. But, the hadoop example is just one of our uses. There are another ones that not necessarily use HPC environment. So, the private cloud will be a easy way to provide infrastructure. And, there are others that use clusters but aren't map and reduce tasks, not using hadoop. 

> best,
> Joe Gordon
> 
> 
> On Thu, Jan 19, 2012 at 10:49 AM, Jorge Luiz Correa <correajl@xxxxxxxxx> wrote:
> Hum, I'm just studying and understanding the ccgroups to try this with libvirt and kvm (all nodes are linux here). 
> 
> My case is a test that can be very useful for us. We have about 150 computers spread over the LAN. These computers are desktops and notebook underutilized. So, our test scenario is not an isolated datacenter, what I think is the ideal scenario for private clouds. 
> 
> We need to run some simulations that requires, most of the time, a lot of processor nodes with not so much memory (for example, to run Hadoop). Once the computers have 8 GB or 16 GB and are used to run office applications, they are idle. We think to attach them to the cloud (a controller of a private cloud) and use these idle resources. But, we want to ensure nova-compute not interfere in computers' usability (in this case we can define what is considered usability, like 2 cores and 4 GB of memory). These idle resources over the LAN can be VERY useful, and are cheap (they have already been purchased)!
> 
> And, we have a laboratory with 20 good hosts that is used along some periods of time. At the lab we can use all the hosts resources when it isn't being used. 
> 
> This is our test scenario.
> 
> Regards.
> 
> :)
> 
> 
> On Thu, Jan 19, 2012 at 4:00 PM, Christian Berendt <berendt@xxxxxxxxxxxxx> wrote:
> Hi Jorge.
> 
> > I would like to know if it's possible to configure quota in each
> > nova-compute node. For example, I set up a new hardware with 8 GB of memory
> > and install the nova-compute, but I wish only 4 GB of memory are used
> > (dedicated to nova-compute). Is it possible? If so, how can I configure
> > that?
> 
> I can't remember such a function at the moment, but it's relative simple
> to implement such a feature (at least for Linux systems) using cgroups.
> 
> Can you please describe your use case. At the moment I can't follow
> where I should use the feature. Why should I install nova-compute on a
> bare metal system with 32 GByte memory and only use 16 GByte memory?
> 
> Bye, Christian.
> 
> --
> Christian Berendt
> Linux / Unix Consultant & Developer
> Mail: berendt@xxxxxxxxxxxxx
> 
> B1 Systems GmbH
> Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de
> GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537
> 
> 
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
> 
> 
> 
> 
> -- 
> - MSc. Correa, J.L.
> 
> 
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
> 
>