launchpad-dev team mailing list archive

[Marc Tardif <marc.tardif@xxxxxxxxxx>]

* Robert Collins <robertc@xxxxxxxxxxxxxxxxx> [2011-06-01 14:30 +1200]:
[snip]
> Rather than repeat the wiki page here, I'd love it if you were to go
> and have a read, and reply to this thread with your thoughts. All the
> discussions I previously put off - e.g. should we use a message queue
> as the default internal protocol - are now up for discussion!

Regarding the blob storage section of the ServiceRoadmap wiki page,
I would like to propose lpresults.storage in the Launchpad Results
project. Even though I'm shamelessly pimping my own solution, the pros
are that it supports modular backends (currently filesystem and S3),
does not rely on a database to manage blobs and is Zope3 friendly. The
cons are that it does not coalesce the content of files by hash. Even
if another solution might be preferable, like HDFS for example, this
could potentially be implemented as another backend.

-- 
Marc Tardif <marc.tardif@xxxxxxxxxxxxx>
Freenode: cr3, Jabber: cr3@xxxxxxxxxx
1024D/72679CAD 09A9 D871 F7C4 A18F AC08 674D 2B73 740C 7267 9CAD