fuel-dev team mailing list archive
-
fuel-dev team
-
Mailing list archive
-
Message #01225
Re: overcommit rates
Hi,
IMHO,
1. Yes
2. In theory, it's possible to change/update values after deployment time.
It's not a dangerous operation. If node is full, it won't be selected for
new VM starts.
3. If it's changed manually, it will be reset on next puppet run.
~Sergii
On Tue, Jun 24, 2014 at 5:21 PM, David Easter <deaster@xxxxxxxxxxxx> wrote:
> Dmitriy,
>
> Once set through the UI, I have a few questions on expectations
> post-deployment:
>
> 1. Would the value selected need to be shown within the Fuel UI
> post-deployment to let the administrator know what value was selected per
> environment?
> 2. Is there an expectation that the value can be changed in a running
> environment, or would this only be expected at deployment time?
> 3. If the value were changed in the environment manually, would be
> expected that the Fuel Master Node would need to monitor for such changes?
>
> Thanks,
>
> - David J. Easter
> Director of Product Management, Mirantis
>
> From: Dmitriy Novakovskiy <dnovakovskiy@xxxxxxxxxxxx>
> Date: Tuesday, June 24, 2014 at 4:37 AM
> To: Bogdan Dobrelya <bdobrelia@xxxxxxxxxxxx>
> Cc: fuel-dev <fuel-dev@xxxxxxxxxxxxxxxxxxx>
> Subject: Re: [Fuel-dev] overcommit rates
>
> All,
>
> I've submitted a blueprint on this:
> https://blueprints.launchpad.net/fuel/+spec/cpu-overcommit-setting
>
> Bogdan,
>
> Nice and creative approach, but IMO the question of "how many instances to
> run" and "what overcommit to use" belongs more to planning/architecture
> workshop/BOM calculator
> <http://www.mirantis.com/openstack-services/bom-calculator/> phase. Not
> only amount of VMs to run on given amount of Compute nodes counts here -
> also the capability of hypervisor to "juggle" oversubscribed cores (poor in
> KVM, better in ESXi), the kind of environment (Prod, Dev/Test), the level
> of tolerance to VM failure, etc. Fuel just need to prompt+allow user to
> apply decisions made at planning phase to deployment phase.
>
>
>
> ---
> Regards,
> Dmitriy
>
>
> On Tue, Jun 24, 2014 at 2:22 PM, Bogdan Dobrelya <bdobrelia@xxxxxxxxxxxx>
> wrote:
>
>> On 06/24/2014 01:50 PM, Dmitriy Novakovskiy wrote:
>> > Andrey, Dmitriy
>> >
>> > I've just realized that CPU overcommitment setting is defined not for
>> > Controllers but for Compute nodes, and may differ on per-node basis. So,
>> > the 2nd "harm" example that I exposed a few emails ago (with failed and
>> > redeployed controller resulting in inconsistent overcommitment behavior)
>> > is irrelevant.
>> >
>> > With this in mind, 3rd example is even worse :)
>> >
>> > 3) User goes through architecture workshop and capacity planning
>> > exercise, decides on CPU overcommit rates he/she will use for OpenStack
>> > cloud. User deploys the cloud with, let's say, 20+ compute nodes. Now,
>> > w/o CPU overcommit setting on GUI, User will:
>> > - get a cloud that's inconsistent with decisions made during planning
>> > - be not aware of this - GUI did not point user to a need of specifying
>> > this setting
>> > - be frustrated and put under risk - if the cloud is deployed with real
>> > workloads the compute nodes will soon become over provisioned and
>> > unreliable due to default Fuel setting (prod KVM clouds often use
>> > super-soft overcommit setting, or no overcommit at all)
>> > - finally - *user will have to MANUALLY specify and maintain overcommit
>> > setting across 20+ compute nodes.*
>> > *
>> > *
>> > Doesn't sound like a good UX from cloud lifecycle management app :) -
>> > Fuel will quickly be ditched in favor of config management tool.
>> >
>> > So, my proposal on CPU overcommitment setting is following:
>> >
>> > - Expose it in Wizard on hypervisor selection screen
>> > - To simplify things initially - implement the setting as a drop-down
>> > list, with 2 options:
>> > -- No CPU overcommitment (1:1)
>> > -- Light CPU overcommitment (3:1)
>> > -- Heavy CPU overcommitment (6:1) --- default setting in BOM calculator
>>
>> Good point. We could as well evaluate the suggested ratio based on the
>> user outputs and roles allocation, e.g.:
>> 1) Q(wizard):"How many running instances your cloud has to maintain?" ->
>> user specifies 10000
>> 2) and there are 100 compute nodes assigned in UI
>>
>> then,
>> - the CPU overcommitment should be evaluated as 10000/100 : 1
>> - if the value exceeds the default maximum (16) for OSt, the warning
>> should be issued in UI notifications (please provide more compute nodes
>> in order to maintain the desired capacity for running instances)
>>
>> >
>> >
>> > ---
>> > Regards,
>> > Dmitriy
>> >
>> >
>> > On Tue, Jun 24, 2014 at 1:23 PM, Andrey Danin <adanin@xxxxxxxxxxxx
>> > <mailto:adanin@xxxxxxxxxxxx>> wrote:
>> >
>> > I think, we can add to openstack.yaml a special tag "advanced" to
>> > every advanced parameter, and UI can hide all such parameters for
>> > every group under the button "show more options". Also we can add
>> > the "expand all hidden options" button at the top of the tab. I
>> > don't think it's hard to implement.
>> >
>> > Let's wait an opinion of UI team.
>> >
>> > On Jun 24, 2014 1:58 PM, "Meg McRoberts" <mmcroberts@xxxxxxxxxxxx
>> > <mailto:mmcroberts@xxxxxxxxxxxx>> wrote:
>> >
>> > Jesse and others make a very good point. The Settings screen
>> > has already become a real mess
>> > that needs to be split up and organized a bit. I'm told that
>> > the serious restructuring should come
>> > after we implement the plug-ins scheme (currently planned for
>> > 6.0). And each section definitely
>> > needs an "Advanced" section for configurations that aren't
>> routine.
>> >
>> > So do we wait to restructure the "Settings" screen until the
>> > plug-ins scheme is implemented? I
>> > think breaking it up into sub-sections would make it more usable
>> > in the meantime but I don't know
>> > if it's worth the effort to do that ahead of the plug-ins.
>> >
>> >
>> > On Tue, Jun 24, 2014 at 2:23 AM, Jesse Pretorius
>> > <jesse.pretorius@xxxxxxxxx <mailto:jesse.pretorius@xxxxxxxxx>>
>> > wrote:
>> >
>> > On 23 June 2014 23:02, Dmitry Borodaenko
>> > <dborodaenko@xxxxxxxxxxxx <mailto:dborodaenko@xxxxxxxxxxxx
>> >>
>> > wrote:
>> >
>> > Adding a configuration variable that can easily be
>> > changed after
>> > deployment is completed into Fuel is a slippery slope,
>> > you risk
>> > spamming the already overcrowded Fuel settings page with
>> > dozens of
>> > trivial (and not so trivial) options from every
>> > OpenStack component.
>> >
>> >
>> > While I agree, the fact of the matter is that Fuel
>> > facilitates the deployment of configuration to all nodes in
>> > the environment in a consistent manner. This is essential to
>> > deploy a reliable and supportable environment.
>> >
>> > In order to maintain the simplicity of the UI, but also
>> > provide access to OpenStack's customisable configuration,
>> > why not do something like add an 'advanced' button into the
>> > UI. Under there, the additional options can be provided, and
>> > things that are already 'Advanced' (like the scheduler, the
>> > Ceph replication factor, etc) can move under the 'Advanced'
>> > button for each section.
>> >
>> > An additional very beneficial feature in the Advanced
>> > section would be to allow any arbitrary key-value pairs for
>> > any settings that a user may wish to deploy into the
>> > configuration files for the appropriate system (eg:
>> > nova.conf). The user can be warned that these will not be
>> > validated and that they are used at the user's own risk.
>> > This can allow any number of OpenStack underlying features
>> > to be used without requiring a specific UI for it.
>> >
>> > --
>> > Mailing list: https://launchpad.net/~fuel-dev
>> > Post to : fuel-dev@xxxxxxxxxxxxxxxxxxx
>> > <mailto:fuel-dev@xxxxxxxxxxxxxxxxxxx>
>> > Unsubscribe : https://launchpad.net/~fuel-dev
>> > More help : https://help.launchpad.net/ListHelp
>> >
>> >
>> >
>> > --
>> > Mailing list: https://launchpad.net/~fuel-dev
>> > Post to : fuel-dev@xxxxxxxxxxxxxxxxxxx
>> > <mailto:fuel-dev@xxxxxxxxxxxxxxxxxxx>
>> > Unsubscribe : https://launchpad.net/~fuel-dev
>> > More help : https://help.launchpad.net/ListHelp
>> >
>> >
>> > --
>> > Mailing list: https://launchpad.net/~fuel-dev
>> > Post to : fuel-dev@xxxxxxxxxxxxxxxxxxx
>> > <mailto:fuel-dev@xxxxxxxxxxxxxxxxxxx>
>> > Unsubscribe : https://launchpad.net/~fuel-dev
>> > More help : https://help.launchpad.net/ListHelp
>> >
>> >
>> >
>> >
>>
>>
>> --
>> Best regards,
>> Bogdan Dobrelya,
>> Skype #bogdando_at_yahoo.com
>> Irc #bogdando
>>
>
> -- Mailing list: https://launchpad.net/~fuel-dev Post to :
> fuel-dev@xxxxxxxxxxxxxxxxxxx Unsubscribe : https://launchpad.net/~fuel-dev
> More help : https://help.launchpad.net/ListHelp
>
> --
> Mailing list: https://launchpad.net/~fuel-dev
> Post to : fuel-dev@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~fuel-dev
> More help : https://help.launchpad.net/ListHelp
>
>
Follow ups
References
-
overcommit rates
From: Dmitriy Novakovskiy, 2014-06-23
-
Re: overcommit rates
From: Andrey Danin, 2014-06-23
-
Re: overcommit rates
From: Dmitriy Novakovskiy, 2014-06-23
-
Re: overcommit rates
From: Andrey Danin, 2014-06-23
-
Re: overcommit rates
From: Dmitriy Novakovskiy, 2014-06-23
-
Re: overcommit rates
From: Dmitry Borodaenko, 2014-06-23
-
Re: overcommit rates
From: Jesse Pretorius, 2014-06-24
-
Re: overcommit rates
From: Meg McRoberts, 2014-06-24
-
Re: overcommit rates
From: Andrey Danin, 2014-06-24
-
Re: overcommit rates
From: Dmitriy Novakovskiy, 2014-06-24
-
Re: overcommit rates
From: Bogdan Dobrelya, 2014-06-24
-
Re: overcommit rates
From: Dmitriy Novakovskiy, 2014-06-24
-
Re: overcommit rates
From: David Easter, 2014-06-24