← Back to team overview

gwibber-bugs team mailing list archive

Re: [Bug 539275] Re: gwibber_messages couchdb views use more disk space than needed

 

lucid users can safely use this ppa https://launchpad.net/~*gwibber*-*team*
/+archive/*ppa which fixes this bug including a ton of other bugs too.*

On Fri, Dec 3, 2010 at 3:52 PM, Tom Goh <539275@xxxxxxxxxxxxxxxxxx>
wrote:

> hmm, what is the fixed version for Ubuntu 10.04 LTS
>
> I guess I am going to do an apt-get purge gwibber because nothing ever
> gets fixed and gets pushed around.
>
> --
> You received this bug notification because you are subscribed to
> Gwibber.
> https://bugs.launchpad.net/bugs/539275
>
> Title:
>   gwibber_messages couchdb views use more disk space than needed
>
> Status in Gwibber:
>  Invalid
> Status in “gwibber” package in Ubuntu:
>   Invalid
> Status in “gwibber” source package in Lucid:
>  Triaged
> Status in “gwibber” package in Debian:
>  Invalid
>
> Bug description:
>  A lot of the views in the gwibber_messages couchdb database emit doc as
> the value. This is unnecessary, as any view can me made to return the
> document in its rows by calling it with the parameter include_docs=true, and
> I believe it wastes a lot of disk space, as the views are stored in their
> entirety. On my machine, with somewhere around 50K messages in gwibber, the
> database (after compaction) takes 78MB, whereas the views for it take over
> 1GB.
>
> I have started work on a branch that fixes this, which should be pretty
> small, but it's a little more work than I expected, absent any kind of
> tests. I'll try to add tests for the changes I make at least.
>
> (Another space saver is to use much shorter document ids. It looks like
> gwibber generates its own ids, so I'd suggest encoding the uuids to base64
> to use less bytes or something. Obviously I'm polluting my own bug here, I
> just wanted to make note of it somewhere in case I forget to follow up on
> it.)
>
>
>

-- 
You received this bug notification because you are a member of Gwibber
Bug Heros, which is subscribed to Gwibber.
https://bugs.launchpad.net/bugs/539275

Title:
  gwibber_messages couchdb views use more disk space than needed

Status in Gwibber:
  Invalid
Status in “gwibber” package in Ubuntu:
  Invalid
Status in “gwibber” source package in Lucid:
  Triaged
Status in “gwibber” package in Debian:
  Invalid

Bug description:
  A lot of the views in the gwibber_messages couchdb database emit doc as the value. This is unnecessary, as any view can me made to return the document in its rows by calling it with the parameter include_docs=true, and I believe it wastes a lot of disk space, as the views are stored in their entirety. On my machine, with somewhere around 50K messages in gwibber, the database (after compaction) takes 78MB, whereas the views for it take over 1GB.

I have started work on a branch that fixes this, which should be pretty small, but it's a little more work than I expected, absent any kind of tests. I'll try to add tests for the changes I make at least.

(Another space saver is to use much shorter document ids. It looks like gwibber generates its own ids, so I'd suggest encoding the uuids to base64 to use less bytes or something. Obviously I'm polluting my own bug here, I just wanted to make note of it somewhere in case I forget to follow up on it.)





References