← Back to team overview

openstack team mailing list archive

Re: Howto Nova setup with HA?

 

Jay,

Thanks, Ill be looking forward to it.

Please let me point you to this article about why I would like to raise this question on whether it would be possible to make Nova more flexible on accepting multiple MySQL connection points. I mean, why would you add another layer of difficulty if it is not needed?

http://openlife.cc/blogs/2011/july/ultimate-mysql-high-availability-solution

Best regards,

Tristan van Bokkem
Datacenter Operations

Contact:
E-mail Personal: tristanvanbokkem@xxxxxxx
E-mail Support: info@xxxxxxx
E-mail NOC: noc@xxxxxxx
Website: http://www.i3d.net Office:
Interactive 3D B.V.
Meent 93b
3011 JG Rotterdam
The Netherlands

Visit www.smartdc.net – SmartDC is our in-house 36,000 sq. ft. datacenter in Rotterdam, The Netherlands. High density hosting – multiple fiber carriers in-house – Level3 PoP.

Interactive 3D (i3D.net) is a company registered in The Netherlands at Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content protection and security. We are ranked in the Deloitte Technology Fast 50 as one of the fastest growing technology companies.
  _____  

From: Jay Pipes [mailto:jaypipes@xxxxxxxxx]
To: i3D.net - Tristan van Bokkem [mailto:tristanvanbokkem@xxxxxx]
Cc: Alexis Richardson [mailto:alexis@xxxxxxxxxxxx], openstack@xxxxxxxxxxxxxxxxxxx
Sent: Thu, 16 Feb 2012 13:46:31 +0100
Subject: Re: [Openstack] Howto Nova setup with HA?

On 02/16/2012 07:32 AM, i3D.net - Tristan van Bokkem wrote:
  > Interesting. Could you point us to the github location?
  
  I will as soon as I verify with Nati that all the most-current code has 
  been pushed there :) Expect an email later today.
  
  > Anyway, ive have done some further research myself and find this very
  > interesting mysql replication setup done by wsrep
  > (https://launchpad.net/wsrep) and galeria
  > (https://launchpad.net/galera/) where mysql will run as a Synchronous
  > Multi-Master replication setup.
  >
  > I have this running and works perfect but the problem now is. I need to
  > add some kind of loadbalancing setup as nova can only point to one mysql
  > location (i.e. --sql_connection=) So if I would point it to one of the
  > mysql nodes in the cluster and that one fails everything fails. Adding a
  > loadbalancer and point it to that will keep my mysql alive.
  
  Yep, this is a perfectly good solution for MySQL.
  
  > The main issue with this is, we are adding another point where we have
  > yet to configure and maintain several more nodes. I would like to raise
  > the question if it would be possible for nova to accept multiple mysql
  > connection points and therefor drop the need for extra loadbalancer
  > component and reducing complexity.
  
  I would strongly resist pressure to add complexity to the Nova (or other 
  core projects) code base when an existing solution is available that is 
  tailored to meet the need already (install a loadbalancer...)
  
  Cheers,
  -kjay
  
  > Best regards,
  >
  > Tristan van Bokkem
  > Datacenter Operations
  >
  > Contact:
  > E-mail Personal: tristanvanbokkem@xxxxxxx <mailto:tristanvanbokkem@xxxxxxx>
  > E-mail Support: info@xxxxxxx <mailto:info@xxxxxxx>
  > E-mail NOC: noc@xxxxxxx <mailto:noc@xxxxxxx>
  > Website: http://www.i3d.net Office:
  > Interactive 3D B.V.
  > Meent 93b
  > 3011 JG Rotterdam
  > The Netherlands
  >
  > Visit www.smartdc.net – SmartDC is our in-house 36,000 sq. ft.
  > datacenter in Rotterdam, The Netherlands. High density hosting –
  > multiple fiber carriers in-house – Level3 PoP.
  >
  > Interactive 3D (i3D.net) is a company registered in The Netherlands at
  > Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL
  > 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on content
  > protection and security. We are ranked in the Deloitte Technology Fast
  > 50 as one of the fastest growing technology companies.
  >
  >     ------------------------------------------------------------------------
  >     *From:* Jay Pipes [mailto:jaypipes@xxxxxxxxx]
  >     *To:* Alexis Richardson [mailto:alexis@xxxxxxxxxxxx]
  >     *Cc:* openstack@xxxxxxxxxxxxxxxxxxx
  >     *Sent:* Thu, 16 Feb 2012 13:11:36 +0100
  >     *Subject:* Re: [Openstack] Howto Nova setup with HA?
  >
  >     Yup, absolutely... we've been a bit slammed working on getting the
  >     project up and running, but everything is checked in to GitHub... just
  >     needs a bit of clean up, that's all.
  >
  >     Best,
  >     -jay
  >
  >     On 02/16/2012 07:10 AM, Alexis Richardson wrote:
  >      > It would be great to see the cookbooks if they are available, since
  >      > others doing that setups might want such a thing.
  >      >
  >      >
  >      >
  >      > On Thu, Feb 16, 2012 at 11:51 AM, Jay Pipes<jaypipes@xxxxxxxxx
  >     <mailto:jaypipes@xxxxxxxxx>> wrote:
  >      >> FWIW, we're using DRBD + pacemaker in active/passive setups for
  >     both the
  >      >> MySQL and RabbitMQ setup in the trystack.org (the artist
  >     formerly known as
  >      >> FreeCloud) project, and it's working quite well and is pretty
  >     simple to set
  >      >> up. Nati Ueno could give some more details on the setup and the Chef
  >      >> cookbooks used...
  >      >>
  >      >> Best,
  >      >> -jay
  >      >>
  >      >> On 02/16/2012 03:46 AM, i3D.net - Tristan van Bokkem wrote:
  >      >>>
  >      >>> Any more thoughts about this subject? Ask? Vish?
  >      >>>
  >      >>> Best regards,
  >      >>>
  >      >>> Tristan van Bokkem
  >      >>> Datacenter Operations
  >      >>>
  >      >>> Contact:
  >      >>> E-mail Personal: tristanvanbokkem@xxxxxxx
  >     <mailto:tristanvanbokkem@xxxxxxx>
  >      >>> <mailto:tristanvanbokkem@xxxxxxx <mailto:tristanvanbokkem@xxxxxxx>>
  >      >>> E-mail Support: info@xxxxxxx
  >     <mailto:info@xxxxxxx><mailto:info@xxxxxxx <mailto:info@xxxxxxx>>
  >      >>> E-mail NOC: noc@xxxxxxx <mailto:noc@xxxxxxx><mailto:noc@xxxxxxx
  >     <mailto:noc@xxxxxxx>>
  >      >>> Website: http://www.i3d.net Office:
  >      >>> Interactive 3D B.V.
  >      >>> Meent 93b
  >      >>> 3011 JG Rotterdam
  >      >>> The Netherlands
  >      >>>
  >      >>> Visit www.smartdc.net – SmartDC is our in-house 36,000 sq. ft.
  >      >>> datacenter in Rotterdam, The Netherlands. High density hosting –
  >      >>> multiple fiber carriers in-house – Level3 PoP.
  >      >>>
  >      >>> Interactive 3D (i3D.net) is a company registered in The
  >     Netherlands at
  >      >>> Meent 93b, Rotterdam. Registration #: 14074337 - VAT # NL
  >      >>> 8202.63.886.B01. Interactive 3D (i3D.net) is CDSA certified on
  >     content
  >      >>> protection and security. We are ranked in the Deloitte
  >     Technology Fast
  >      >>> 50 as one of the fastest growing technology companies.
  >      >>>
  >      >>>
  >      >>>
  >     ------------------------------------------------------------------------
  >      >>> *From:* Alexis Richardson [mailto:alexis@xxxxxxxxxxxx
  >     <mailto:alexis@xxxxxxxxxxxx>]
  >      >>> *To:* Major Hayden [mailto:major.hayden@xxxxxxxxxxxxx
  >     <mailto:major.hayden@xxxxxxxxxxxxx>]
  >      >>> *Cc:* i3D.net - Tristan van Bokkem
  >     [mailto:tristanvanbokkem@xxxxxx <mailto:tristanvanbokkem@xxxxxx>],
  >      >>> <openstack@xxxxxxxxxxxxxxxxxxx
  >     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>>
  >      >>> [mailto:openstack@xxxxxxxxxxxxxxxxxxx
  >     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>], Ask Solem
  >      >>> [mailto:ask@xxxxxxxxxxxx <mailto:ask@xxxxxxxxxxxx>]
  >      >>> *Sent:* Tue, 14 Feb 2012 14:47:13 +0100
  >      >>> *Subject:* Re: [Openstack] Howto Nova setup with HA?
  >      >>>
  >      >>>
  >      >>> Major,
  >      >>>
  >      >>> The current set-up of HA in Openstack is borked in several ways.
  >      >>>
  >      >>> Ask Solem, cc'd, is going to write up a note helping people to
  >     do it
  >      >>> properly.
  >      >>>
  >      >>> alexis
  >      >>>
  >      >>>
  >      >>> On Tue, Feb 14, 2012 at 1:34 PM, Major Hayden
  >      >>> <major.hayden@xxxxxxxxxxxxx
  >     <mailto:major.hayden@xxxxxxxxxxxxx><mailto:major.hayden@xxxxxxxxxxxxx <mailto:major.hayden@xxxxxxxxxxxxx>>>
  >     wrote:
  >      >>> > On Feb 14, 2012, at 2:07 AM, i3D.net - Tristan van Bokkem wrote:
  >      >>> >
  >      >>> >> So, we can run MySQL in master-master mode on multiple hosts, we
  >      >>> can run nova-api on serveral hosts and load balance those and
  >      >>> RabbitMQ has a cluster ha setup as well but is this the way to
  >     go? I
  >      >>> can't find a clear answer to this. I am hoping one can shine some
  >      >>> light on this!
  >      >>> >
  >      >>> > If you want to make things a little simpler, an active/passive
  >      >>> MySQL setup with pacemaker, corosync, and DRBD will work quite
  >     well.
  >      >>> ClusterLabs has a pretty decent howto on their site:
  >      >>> >
  >      >>> > http://www.clusterlabs.org/wiki/DRBD_MySQL_HowTo
  >      >>> >
  >      >>> > As for RabbitMQ clustering, I worked with it for several days and
  >      >>> had quite a few problems with data consistency and availability. We
  >      >>> eventually settled on the "legacy" H/A method for RabbitMQ using
  >      >>> pacemaker and DRBD. There's a pretty good walkthrough on RabbitMQ's
  >      >>> site:
  >      >>> >
  >      >>> > http://www.rabbitmq.com/pacemaker.html
  >      >>> >
  >      >>> > --
  >      >>> > Major Hayden
  >      >>> > _______________________________________________
  >      >>> > Mailing list: https://launchpad.net/~openstack
  >     <https://launchpad.net/%7Eopenstack>
  >      >>> <https://launchpad.net/%7Eopenstack>
  >      >>> > Post to : openstack@xxxxxxxxxxxxxxxxxxx
  >     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
  >      >>> <mailto:openstack@xxxxxxxxxxxxxxxxxxx
  >     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>>
  >      >>> > Unsubscribe : https://launchpad.net/~openstack
  >     <https://launchpad.net/%7Eopenstack>
  >      >>> <https://launchpad.net/%7Eopenstack>
  >      >>> > More help : https://help.launchpad.net/ListHelp
  >      >>>
  >      >>>
  >      >>>
  >      >>>
  >      >>> _______________________________________________
  >      >>> Mailing list: https://launchpad.net/~openstack
  >     <https://launchpad.net/%7Eopenstack>
  >      >>> Post to : openstack@xxxxxxxxxxxxxxxxxxx
  >     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
  >      >>> Unsubscribe : https://launchpad.net/~openstack
  >     <https://launchpad.net/%7Eopenstack>
  >      >>> More help : https://help.launchpad.net/ListHelp
  >      >>
  >      >>
  >      >> _______________________________________________
  >      >> Mailing list: https://launchpad.net/~openstack
  >     <https://launchpad.net/%7Eopenstack>
  >      >> Post to : openstack@xxxxxxxxxxxxxxxxxxx
  >     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
  >      >> Unsubscribe : https://launchpad.net/~openstack
  >     <https://launchpad.net/%7Eopenstack>
  >      >> More help : https://help.launchpad.net/ListHelp
  >
  >     _______________________________________________
  >     Mailing list: https://launchpad.net/~openstack
  >     <https://launchpad.net/%7Eopenstack>
  >     Post to : openstack@xxxxxxxxxxxxxxxxxxx
  >     <mailto:openstack@xxxxxxxxxxxxxxxxxxx>
  >     Unsubscribe : https://launchpad.net/~openstack
  >     <https://launchpad.net/%7Eopenstack>
  >     More help : https://help.launchpad.net/ListHelp
  >
    

References