← Back to team overview

gwibber-bugs team mailing list archive

[Bug 539275] Re: gwibber_messages couchdb views use more disk space than needed

 

https://launchpad.net/~gwibber-team/+archive/ppa

-- 
You received this bug notification because you are a member of Gwibber
Bug Heros, which is subscribed to Gwibber.
https://bugs.launchpad.net/bugs/539275

Title:
  gwibber_messages couchdb views use more disk space than needed

Status in Gwibber:
  Invalid
Status in “gwibber” package in Ubuntu:
  Invalid
Status in “gwibber” source package in Lucid:
  Triaged
Status in “gwibber” package in Debian:
  Invalid

Bug description:
  A lot of the views in the gwibber_messages couchdb database emit doc as the value. This is unnecessary, as any view can me made to return the document in its rows by calling it with the parameter include_docs=true, and I believe it wastes a lot of disk space, as the views are stored in their entirety. On my machine, with somewhere around 50K messages in gwibber, the database (after compaction) takes 78MB, whereas the views for it take over 1GB.

I have started work on a branch that fixes this, which should be pretty small, but it's a little more work than I expected, absent any kind of tests. I'll try to add tests for the changes I make at least.

(Another space saver is to use much shorter document ids. It looks like gwibber generates its own ids, so I'd suggest encoding the uuids to base64 to use less bytes or something. Obviously I'm polluting my own bug here, I just wanted to make note of it somewhere in case I forget to follow up on it.)