← Back to team overview

savanna-all team mailing list archive

Re: Hadoop Provider Integration

 

Hey Erik,

Some tables in "Savanna Deployment Engine Architecture" doc are flattened
out, see attached screenshot for example. Could you reassemble the PDF with
correct tables' sizes?

Thanks,

Dmitry


2013/4/30 Erik Bergenholtz <ebergenholtz@xxxxxxxxxxxxxxx>

> Team - yet another update. See
> https://wiki.openstack.org/w/images/9/97/Savanna_hadoop_host_group_mapping.pdf for
> a document illustrating how hadoop nodes get mapped to provisioned VMs.
>
> Erik
>
>
>
> On Apr 30, 2013, at 11:07 AM, Erik Bergenholtz <
> ebergenholtz@xxxxxxxxxxxxxxx> wrote:
>
> Team,  John has updated the below referenced documents with better
> descriptions of the flows (same links apply).
>
> Cheers,
>
> Erik
>
> On Apr 30, 2013, at 6:35 AM, Erik Bergenholtz <
> ebergenholtz@xxxxxxxxxxxxxxx> wrote:
>
> Team,
>
> Below are a few documents intended to describe only a slightly modified
> approach to hadoop provider integration into Savanna (see existing
> blueprint in draft:
> https://blueprints.launchpad.net/savanna/+spec/pluggable-cluster-provisioning). These
> documents should not be considered a blueprint, but a vehicle for
> continuing discussion on the topic.
>
> To summarize there are two changes to note:
>
> 1. There is some IoC introduced into the design allowing hadoop plugin
> providers flexibility to integrate into Savanna while reducing the burden
> on the Savanna controller itself. This differs from the current approach of
> the controller invoking APIs on the provider at specific lifecycle points.
>
> 2. Attempts have been made to keep normalization of management APIs across
> providers at a minimum at the controller level. Our view is that existing
> Hadoop users are already familiar with their Hadoop distribution management
> API (CDH, Ambari, MapR etc.) and as such would want to leverage existing
> investments vs. learning a new management API specific to Savanna. This
> eases adoption and lowers the barrier of entry of adoption of Hadoop on
> OpenStack.
>
> Documents to review:
>
> Savanna Deployment Engine Architecture<https://wiki.openstack.org/w/images/5/5e/Savanna_Deployment_Engine_Architecture.pdf> -
> Puts forth the architecture of the deployment engine
> Savanna_add_hosts_flow<https://wiki.openstack.org/w/images/d/dc/Savanna_add_hosts_flow.pdf> -
> Describes sequence of steps executed in order to add a host to an existing
> Hadoop Cluster
> Savanna_create_cluster_flow<https://wiki.openstack.org/w/images/0/0f/Savanna_create_cluster_flow.pdf> -
> Describes the sequence of steps executed in order to create a new cluster
> Savanna_invoke_provider_rest_api_flow<https://wiki.openstack.org/w/images/a/a6/Savanna_invoke_provider_rest_api_flow.pdf> -
> Describes the sequence of steps executed in a REST request by the provider
> plugin on the controller.
>
> Please review at your earliest convenience and let us know your feedback.
>
> Best,
>
> Jon Maron, John Speidel and Erik Bergenholtz
>
>
>
>
>
> --
> Mailing list: https://launchpad.net/~savanna-all
> Post to     : savanna-all@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~savanna-all
> More help   : https://help.launchpad.net/ListHelp
>
>

Attachment: Screen Shot 2013-04-30 at 1.15.11 PM.png
Description: PNG image


Follow ups

References