← Back to team overview

openstack team mailing list archive

  1. openstack team
  2. Mailing list archive
  3. Message #07667

Re: Howto Nova setup with HA?

  Thread Previous • Date Previous • • Thread Next 
On 02/16/2012 07:32 AM, i3D.net - Tristan van Bokkem wrote:

Interesting. Could you point us to the github location?
I will as soon as I verify with Nati that all the most-current code has been pushed there :) Expect an email later today. 


Anyway, ive have done some further research myself and find this very
interesting mysql replication setup done by wsrep
(https://launchpad.net/wsrep) and galeria
(https://launchpad.net/galera/) where mysql will run as a Synchronous
Multi-Master replication setup.

I have this running and works perfect but the problem now is. I need to
add some kind of loadbalancing setup as nova can only point to one mysql
location (i.e. --sql_connection=) So if I would point it to one of the
mysql nodes in the cluster and that one fails everything fails. Adding a
loadbalancer and point it to that will keep my mysql alive.


Yep, this is a perfectly good solution for MySQL.


The main issue with this is, we are adding another point where we have
yet to configure and maintain several more nodes. I would like to raise
the question if it would be possible for nova to accept multiple mysql
connection points and therefor drop the need for extra loadbalancer
component and reducing complexity.
I would strongly resist pressure to add complexity to the Nova (or other core projects) code base when an existing solution is available that is tailored to meet the need already (install a loadbalancer...) 

Cheers,
-kjay


Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem@xxxxxxx <mailto:tristanvanbokkem@xxxxxxx>
E-mail Support: info@xxxxxxx <mailto:info@xxxxxxx>
E-mail NOC: noc@xxxxxxx <mailto:noc@xxxxxxx>
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net – SmartDC is our in-house 36,000 sq. ft.
datacenter in Rotterdam, The Netherlands. High density hosting –
multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at
Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL
8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content
protection and security. We are ranked in the Deloitte Technology Fast
50 as one of the fastest growing technology companies.

    ------------------------------------------------------------------------
    *From:* Jay Pipes [mailto:jaypipes@xxxxxxxxx]
    *To:* Alexis Richardson [mailto:alexis@xxxxxxxxxxxx]
    *Cc:* openstack@xxxxxxxxxxxxxxxxxxx
    *Sent:* Thu, 16 Feb 2012 13:11:36 +0100
    *Subject:* Re: [Openstack] Howto Nova setup with HA?

    Yup, absolutely... we've been a bit slammed working on getting the
    project up and running, but everything is checked in to GitHub... just
    needs a bit of clean up, that's all.

    Best,
    -jay

    On 02/16/2012 07:10 AM, Alexis Richardson wrote:
     > It would be great to see the cookbooks if they are available, since
     > others doing that setups might want such a thing.
     >
     >
     >
     > On Thu, Feb 16, 2012 at 11:51 AM, Jay Pipes<jaypipes@xxxxxxxxx
    <mailto:jaypipes@xxxxxxxxx>> wrote:
     >> FWIW, we're using DRBD + pacemaker in active/passive setups for
    both the
     >> MySQL and RabbitMQ setup in the trystack.org (the artist
    formerly known as
     >> FreeCloud) project, and it's working quite well and is pretty
    simple to set
     >> up. Nati Ueno could give some more details on the setup and the Chef
     >> cookbooks used...
     >>
     >> Best,
     >> -jay
     >>
     >> On 02/16/2012 03:46 AM, i3D.net - Tristan van Bokkem wrote:
     >>>
     >>> Any more thoughts about this subject? Ask? Vish?
     >>>
     >>> Best regards,
     >>>
     >>> Tristan van Bokkem
     >>> Datacenter Operations
     >>>
     >>> Contact:
     >>> E-mail Personal: tristanvanbokkem@xxxxxxx
    <mailto:tristanvanbokkem@xxxxxxx>
     >>> <mailto:tristanvanbokkem@xxxxxxx <mailto:tristanvanbokkem@xxxxxxx>>
     >>> E-mail Support: info@xxxxxxx
    <mailto:info@xxxxxxx><mailto:info@xxxxxxx <mailto:info@xxxxxxx>>
     >>> E-mail NOC: noc@xxxxxxx <mailto:noc@xxxxxxx><mailto:noc@xxxxxxx
    <mailto:noc@xxxxxxx>>
     >>> Website: http://www.i3d.net Office:
     >>> Interactive 3D B.V.
     >>> Meent 93b
     >>> 3011 JG Rotterdam
     >>> The Netherlands
     >>>
     >>> Visit www.smartdc.net – SmartDC is our in-house 36,000 sq. ft.
     >>> datacenter in Rotterdam, The Netherlands. High density hosting –
     >>> multiple fiber carriers in-house – Level3 PoP.
     >>>
     >>> Interactive 3D (i3D.net) is a company registered in The
    Netherlands at
     >>> Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL
     >>> 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on
    content
     >>> protection and security. We are ranked in the Deloitte
    Technology Fast
     >>> 50 as one of the fastest growing technology companies.
     >>>
     >>>
     >>>
    ------------------------------------------------------------------------
     >>> *From:* Alexis Richardson [mailto:alexis@xxxxxxxxxxxx
    <mailto:alexis@xxxxxxxxxxxx>]
     >>> *To:* Major Hayden [mailto:major.hayden@xxxxxxxxxxxxx
    <mailto:major.hayden@xxxxxxxxxxxxx>]
     >>> *Cc:* i3D.net - Tristan van Bokkem
    [mailto:tristanvanbokkem@xxxxxx <mailto:tristanvanbokkem@xxxxxx>],
     >>> <openstack@xxxxxxxxxxxxxxxxxxx
    <mailto:openstack@xxxxxxxxxxxxxxxxxxx>>
     >>> [mailto:openstack@xxxxxxxxxxxxxxxxxxx
    <mailto:openstack@xxxxxxxxxxxxxxxxxxx>], Ask Solem
     >>> [mailto:ask@xxxxxxxxxxxx <mailto:ask@xxxxxxxxxxxx>]
     >>> *Sent:* Tue, 14 Feb 2012 14:47:13 +0100
     >>> *Subject:* Re: [Openstack] Howto Nova setup with HA?
     >>>
     >>>
     >>> Major,
     >>>
     >>> The current set-up of HA in Openstack is borked in several ways.
     >>>
     >>> Ask Solem, cc'd, is going to write up a note helping people to
    do it
     >>> properly.
     >>>
     >>> alexis
     >>>
     >>>
     >>> On Tue, Feb 14, 2012 at 1:34 PM, Major Hayden
     >>> <major.hayden@xxxxxxxxxxxxx
    <mailto:major.hayden@xxxxxxxxxxxxx><mailto:major.hayden@xxxxxxxxxxxxx <mailto:major.hayden@xxxxxxxxxxxxx>>>
    wrote:
     >>> > On Feb 14, 2012, at 2:07 AM, i3D.net - Tristan van Bokkem wrote:
     >>> >
     >>> >> So, we can run MySQL in master-master mode on multiple hosts, we
     >>> can run nova-api on serveral hosts and load balance those and
     >>> RabbitMQ has a cluster ha setup as well but is this the way to
    go? I
     >>> can't find a clear answer to this. I am hoping one can shine some
     >>> light on this!
     >>> >
     >>> > If you want to make things a little simpler, an active/passive
     >>> MySQL setup with pacemaker, corosync, and DRBD will work quite
    well.
     >>> ClusterLabs has a pretty decent howto on their site:
     >>> >
     >>> > http://www.clusterlabs.org/wiki/DRBD_MySQL_HowTo
     >>> >
     >>> > As for RabbitMQ clustering, I worked with it for several days and
     >>> had quite a few problems with data consistency and availability. We
     >>> eventually settled on the "legacy" H/A method for RabbitMQ using
     >>> pacemaker and DRBD. There's a pretty good walkthrough on RabbitMQ's
     >>> site:
     >>> >
     >>> > http://www.rabbitmq.com/pacemaker.html
     >>> >
     >>> > --
     >>> > Major Hayden
     >>> > _______________________________________________
     >>> > Mailing list: https://launchpad.net/~openstack
    <https://launchpad.net/%7Eopenstack>
     >>> <https://launchpad.net/%7Eopenstack>
     >>> > Post to : openstack@xxxxxxxxxxxxxxxxxxx
    <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
     >>> <mailto:openstack@xxxxxxxxxxxxxxxxxxx
    <mailto:openstack@xxxxxxxxxxxxxxxxxxx>>
     >>> > Unsubscribe : https://launchpad.net/~openstack
    <https://launchpad.net/%7Eopenstack>
     >>> <https://launchpad.net/%7Eopenstack>
     >>> > More help : https://help.launchpad.net/ListHelp
     >>>
     >>>
     >>>
     >>>
     >>> _______________________________________________
     >>> Mailing list: https://launchpad.net/~openstack
    <https://launchpad.net/%7Eopenstack>
     >>> Post to : openstack@xxxxxxxxxxxxxxxxxxx
    <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
     >>> Unsubscribe : https://launchpad.net/~openstack
    <https://launchpad.net/%7Eopenstack>
     >>> More help : https://help.launchpad.net/ListHelp
     >>
     >>
     >> _______________________________________________
     >> Mailing list: https://launchpad.net/~openstack
    <https://launchpad.net/%7Eopenstack>
     >> Post to : openstack@xxxxxxxxxxxxxxxxxxx
    <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
     >> Unsubscribe : https://launchpad.net/~openstack
    <https://launchpad.net/%7Eopenstack>
     >> More help : https://help.launchpad.net/ListHelp

    _______________________________________________
    Mailing list: https://launchpad.net/~openstack
    <https://launchpad.net/%7Eopenstack>
    Post to : openstack@xxxxxxxxxxxxxxxxxxx
    <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
    Unsubscribe : https://launchpad.net/~openstack
    <https://launchpad.net/%7Eopenstack>
    More help : https://help.launchpad.net/ListHelp

Follow ups

References

  Thread Previous • Date Previous • • Thread Next