← Back to team overview

gwibber-bugs team mailing list archive

[Bug 539275] Re: gwibber_messages couchdb views use more disk space than needed

 

** Changed in: gwibber
     Assignee: Eric Casteleijn (thisfred) => (unassigned)

-- 
You received this bug notification because you are a member of Gwibber
Bug Heros, which is subscribed to Gwibber.
https://bugs.launchpad.net/bugs/539275

Title:
  gwibber_messages couchdb views use more disk space than needed

Status in Gwibber:
  Invalid
Status in “gwibber” package in Ubuntu:
  Invalid
Status in “gwibber” source package in Lucid:
  Triaged
Status in “gwibber” package in Debian:
  Invalid

Bug description:
  A lot of the views in the gwibber_messages couchdb database emit doc
  as the value. This is unnecessary, as any view can me made to return
  the document in its rows by calling it with the parameter
  include_docs=true, and I believe it wastes a lot of disk space, as the
  views are stored in their entirety. On my machine, with somewhere
  around 50K messages in gwibber, the database (after compaction) takes
  78MB, whereas the views for it take over 1GB.

  I have started work on a branch that fixes this, which should be
  pretty small, but it's a little more work than I expected, absent any
  kind of tests. I'll try to add tests for the changes I make at least.

  (Another space saver is to use much shorter document ids. It looks
  like gwibber generates its own ids, so I'd suggest encoding the uuids
  to base64 to use less bytes or something. Obviously I'm polluting my
  own bug here, I just wanted to make note of it somewhere in case I
  forget to follow up on it.)