openstack team mailing list archive

["Brian Lamar" <brian.lamar@xxxxxxxxxxxxx>]

Hey Josh,

>> Has there been any thought on having a nova-db service that responds to requests for 
>> information from the db (or something like a db).

No plans that I'm aware of, there is a Database-as-a-Service project called 'Red Dwarf' which might fit this bill however. I honestly haven't looked too much into it.

>> This could be useful for companies that don't necessarily want to have a limiting 
>> factor being a database. Since when u scale past a certain number of compute nodes the 
>> database connections themselves may become a bottleneck (especially the heartbeat 
>> mechanism which updates a table every X seconds).

Not sure what you mean by this. Currently the OpenStack architecture was built to allow hundreds and thousands (maybe?) of compute nodes in the same environment. The keys is to group compute nodes into clusters as outlined here:

http://wiki.openstack.org/MultiClusterZones

Long story short the database isn't being shared between all compute clusters, but instead a hierarchy of clusters is formed (something I, in a pinch, would consider akin to a distributed Map/Reduce model of data sharing).

Does something like this help out with your scaling concerns? I do know that personally I'd be interested in a CouchDB/NoSQL alternative to the Nova database layer...but what we have right now seems to conceptual work for scaling out to many hundreds of compute nodes.

>> It would be interesting if these types of request could go to the message queue 
>> instead

110% agree. Hopefully this is something we can talk about at the upcoming conference in Boston. :)


-Brian


-----Original Message-----
From: "Joshua Harlow" <harlowja@xxxxxxxxxxxxx>
Sent: Friday, September 23, 2011 5:40pm
To: "openstack" <openstack@xxxxxxxxxxxxxxxxxxx>
Subject: [Openstack] Database replacement?

_______________________________________________
Mailing list: https://launchpad.net/~openstack
Post to     : openstack@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp
This email may include confidential information. If you received it in error, please delete it.
Howdy all, congrats on the diablo release!

Has there been any thought on having a nova-db service that responds to requests for information from the db (or something like a db).

This could be useful for companies that don't necessarily want to have a limiting factor being a database. Since when u scale past a certain number of compute nodes the database connections themselves may become a bottleneck (especially the heartbeat mechanism which updates a table every X seconds). It would be interesting if these types of request could go to the message queue instead and then the db backing could be swapped out with something more scalable (or still use mysql/sqlite...).

Any thoughts?

-Josh