openstack team mailing list archive
-
openstack team
-
Mailing list archive
-
Message #02837
Re: DRBD storage for Openstack installations
Hello everyone,
A bit of follow-up<http://mirantis.blogspot.com/2011/06/clustered-lvm-on-drbd-resource-in.html>on
the subject, concerning clustered locking for the LVM on DRBD
resource.
On Mon, May 30, 2011 at 11:04 AM, Oleg Gelbukh <ogelbukh@xxxxxxxxxxxx>wrote:
> The current OpenStack paradigm seems to be built around external storage,
> which contains user data on attached volumes. However, we wanted to create
> distributed storage on the same nodes we are running nova-compute on.
>
> 2011/5/26 Peter J. Pouliot <ppouliot@xxxxxxxxxx>
>
> Greetings Programs,
>>
>> We to have been toying with a similar idea in our lab. We are using the
>> same model as Oleg, for existing clouds. The current OpenStack paradigm is
>> a bit different. Having not read all his info yet, I hope they include
>> service resources for the openstacks bits configured into his CIB.
>>
>> We have been toying with the idea, of doing linux-ha clusters under the
>> openstack services for service availability across the cloud.
>>
>> p
>>
>>
>>
>>
>> On Thu, May 26, 2011 at 03:11:34PM +0200, Diego Parrilla Santamaría wrote:
>> > Hi Oleg,
>> > thank you very much for your post, it's really didactic. We are
>> taking a
>> > different approach for HA at storage level, but I have worked
>> formerly
>> > with DRBD and I think it's a very good choice.
>> > I'm curious about how you have deployed nova-volume nodes in your
>> > architecture. You don't specify if the two nodes of the DRBD cluster
>> run
>> > one or two instances of nova-volume. If you run one instance probably
>> you
>> > have implemented some kind of fault-tolerant active-passive service
>> if the
>> > nova-volume process fails in the active node, but I would like to
>> know if
>> > you can run an active-active two nova-volume instances on two
>> different
>> > physical nodes on top of the DRBD shared resource.
>> > Regards
>> > Diego�
>> > --
>> > Diego Parrilla
>> > CEO
>> > [1]www.stackops.com |� [2]diego.parrilla@xxxxxxxxxxxx | +34 649 94
>> 43 29 |
>> > skype:diegoparrilla
>> >
>> > On Thu, May 26, 2011 at 1:29 PM, Oleg Gelbukh <[3]
>> ogelbukh@xxxxxxxxxxxx>
>> > wrote:
>> >
>> > Hi,
>> > We were researching Openstack for our private cloud, and want to
>> share
>> > experience and get tips from community as we go on.�
>> > We have settled on DRBD as shared storage platform for our
>> installation.
>> > LVM is used over the drbd device to mange logical volumes. OCFS2
>> file
>> > system is created on one of volumes, mounted and set up as
>> > image_path�and�instance_path in the nova.conf, other space is
>> reserved
>> > for storage volumes (managed by nova-volume).�
>> > As a result, we have shared storage suitable for features such as
>> live
>> > migration and snapshots. We also have some level of
>> fault-tolerance,
>> > with DRBD I/O error handling, which automatically redirects I/O
>> requests
>> > to peer node over network in case of primary node failure. We
>> created
>> > [4]script for bootstrapping lost VMs in two crash scenarios:
>> > * dom0 host restart/domU failure: restore VMs on the same host
>> > * dom0 host failure: restore VMs on peer node
>> > We are considering such pair of servers with shared storage as a
>> basic
>> > block for the cloud structure.
>> > For whom it may interest, the details of DRBD installation are
>> [5]here.
>> > I'll be glad to answer any questions and highly appreciate feedback
>> on
>> > this.
>> > Oleg S. Gelbukh,
>> > Mirantis Inc.
>> > [6]www.mirantis.com
>> > _______________________________________________
>> > Mailing list: [7]https://launchpad.net/~openstack
>> > Post to � � : [8]openstack@xxxxxxxxxxxxxxxxxxx
>> > Unsubscribe : [9]https://launchpad.net/~openstack
>> > More help � : [10]https://help.launchpad.net/ListHelp
>> >
>> > References
>> >
>> > Visible links
>> > 1. http://www.stackops.com/
>> > 2. mailto:diego.parrilla@xxxxxxxxxxxx
>> > 3. mailto:ogelbukh@xxxxxxxxxxxx
>> > 4.
>> https://github.com/Mirantis/openstack-utils/blob/master/recovery_instance_by_id.py
>> > 5.
>> http://mirantis.blogspot.com/2011/05/shared-storage-for-openstack-based-on.html
>> > 6. http://www.mirantis.com/
>> > 7. https://launchpad.net/~openstack
>> > 8. mailto:openstack@xxxxxxxxxxxxxxxxxxx
>> > 9. https://launchpad.net/~openstack
>> > 10. https://help.launchpad.net/ListHelp
>>
>> > _______________________________________________
>> > Mailing list: https://launchpad.net/~openstack
>> > Post to : openstack@xxxxxxxxxxxxxxxxxxx
>> > Unsubscribe : https://launchpad.net/~openstack
>> > More help : https://help.launchpad.net/ListHelp
>>
>>
>
References