← Back to team overview

drizzle-discuss team mailing list archive

Re: GSoC Cloud Based Storage Engine


Thank you, Jobin.

Jay and Stewart's blogs did help a lot. Now I have a working drizzle running in gdb. I am trying to find some small and easy bugs to fix as a start, any suggestion which one is good for me?

About the Cloud Based Storage Engine, here is my understanding and questions, can anybody offer me some suggestion and correction... thanks a lot.

Looking at mysql-awss3, I think the task is same here - implement a cursor (in mysql language it's handler). But I think mysql-awss3 is not a fully working plugin, am I right? It seems only the first non-primary-key field is written. So here is my first question, according to the project description on wiki, "write a Storage Engine (or adapt awss3) for Drizzle - allowing storing and retrieving of blobs from Cloud Storage services such as S3 and Rackspace Files", so only blobs are written to the cloud? If so, what to do with other fields?

On Apr 2, 2010, at 1:19 PM, Jobin Augustine wrote:

Hi Yanbo,
As you already figured out from wiki, took the content from Stewart smith's blog posts only (with his permission).
There are few more blog posts by Stewart Smith which can give you further details.
so if you have time, it is worth brolwsing though his other blog posts also.

Jay also had a blog post on new storage engine APIs.

I hope this will help you,

On Fri, Apr 2, 2010 at 7:35 AM, Yanbo Wu <yanbo.wu@xxxxxxxxx> wrote:
I have fixed this by define this macro in CFLAGS, is there any better way to work around this?

Currently I am trying to follow the tutorial of 'Tutorial_:_Writing_A_Storage_Engine_for_Drizzle' on the wiki, but it seems the link in that page to stewart's skeleton-embedded-innodb-engine is broken.

Anyway, i managed to find the branch source code. Any suggestion for my work and application about the GSoC project?


On Apr 1, 2010, at 1:30 PM, Yanbo Wu wrote:

Dear all,

I am a 2nd year PhD student from the University of Adelaide, Australia. My current research interests include database theory, distributed database systems and cloud computing. Drizzle is very interesting to me. I checked out the wiki page for GSoC and I am interested in the cloud based storage engine sub-project. I have read some of the source code about plugin::StorageEngine and some of its implementation and am going to first implement a very simple storage engine, which does nothing but logging some messages.

However I need some help here for compiling drizzle. My working machine is a macbook pro with snow leopard installed. All libs are installed via macports and upgraded to the latest version. I followed the instructions on drizzle wiki. However something went wrong when I tried to compile it. The error message is

srcdir=. ./config/make-lint.py
CXX    plugin/archive/azio.lo
In file included from plugin/archive/azio.h:45,
              from plugin/archive/azio.cc:16:
/opt/local/include/zlib.h:1568:32: error: "_FILE_OFFSET_BITS" is not defined

Any idea about this?

Thanks and wish I can have the chance to work with you guys.

Best wishes,


Mailing list: https://launchpad.net/~drizzle-discuss
Post to     : drizzle-discuss@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~drizzle-discuss
More help   : https://help.launchpad.net/ListHelp

Follow ups