openstack team mailing list archive

[Joe Gordon <jogo@xxxxxxxxxxxxxxxx>]

Hi Jorge,

I have two questions:

1) Has anyone optimized nova to work in a HPC environment like you
describe? Such as an intelligent scheduler that will generate VMs that
consume x percent of a physical machines resources (so you don't end up
with one machine with two separate Hadoop instances competing for
resources)?

2) Why not use something like
http://en.wikipedia.org/wiki/TORQUE_Resource_Manager or
http://hadoop.apache.org/common/docs/r0.16.4/hod.html?

best,
Joe Gordon


On Thu, Jan 19, 2012 at 10:49 AM, Jorge Luiz Correa <correajl@xxxxxxxxx>wrote:

> Hum, I'm just studying and understanding the ccgroups to try this with
> libvirt and kvm (all nodes are linux here).
>
> My case is a test that can be very useful for us. We have about 150
> computers spread over the LAN. These computers are desktops and notebook
> underutilized. So, our test scenario is not an isolated datacenter, what I
> think is the ideal scenario for private clouds.
>
> We need to run some simulations that requires, most of the time, a lot of
> processor nodes with not so much memory (for example, to run Hadoop). Once
> the computers have 8 GB or 16 GB and are used to run office applications,
> they are idle. We think to attach them to the cloud (a controller of a
> private cloud) and use these idle resources. But, we want to ensure
> nova-compute not interfere in computers' usability (in this case we can
> define what is considered usability, like 2 cores and 4 GB of memory).
> These idle resources over the LAN can be VERY useful, and are cheap (they
> have already been purchased)!
>
> And, we have a laboratory with 20 good hosts that is used along some
> periods of time. At the lab we can use all the hosts resources when it
> isn't being used.
>
> This is our test scenario.
>
> Regards.
>
> :)
>
>
> On Thu, Jan 19, 2012 at 4:00 PM, Christian Berendt <berendt@xxxxxxxxxxxxx>wrote:
>
>> Hi Jorge.
>>
>> > I would like to know if it's possible to configure quota in each
>> > nova-compute node. For example, I set up a new hardware with 8 GB of
>> memory
>> > and install the nova-compute, but I wish only 4 GB of memory are used
>> > (dedicated to nova-compute). Is it possible? If so, how can I configure
>> > that?
>>
>> I can't remember such a function at the moment, but it's relative simple
>> to implement such a feature (at least for Linux systems) using cgroups.
>>
>> Can you please describe your use case. At the moment I can't follow
>> where I should use the feature. Why should I install nova-compute on a
>> bare metal system with 32 GByte memory and only use 16 GByte memory?
>>
>> Bye, Christian.
>>
>> --
>> Christian Berendt
>> Linux / Unix Consultant & Developer
>> Mail: berendt@xxxxxxxxxxxxx
>>
>> B1 Systems GmbH
>> Osterfeldstraße 7 / 85088 Vohburg / http://www.b1-systems.de
>> GF: Ralph Dehner / Unternehmenssitz: Vohburg / AG: Ingolstadt,HRB 3537
>>
>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~openstack
>> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
> - MSc. Correa, J.L.
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>
>