← Back to team overview

launchpad-dev team mailing list archive

Re: Restarting the package importer

 

On 19 October 2011 17:44, Vincent Ladeuil <v.ladeuil+lp@xxxxxxx> wrote:
>>>>>> Martin Pool <mbp@xxxxxxxxxxxxx> writes:
>
>    > wgrant told me that lp database server load was increasing, apparently
>    > due to the package importer.
>
> Yesterday, I progressively raised the max_threads from 8 to 12, 16 and
> finally 24 to catch up with the several days interruption, what kind of
> issue did lp encounter ?
>
> Or was it just surprising from the lp side ?

24 threads talking over GbE to Launchpad as fast as they can, with
each api call causing several database queries puts a pretty
substantial lump in their load graph.  Not catastrophic, but enough
they noticed.

Fortunately it shows up some inefficiencies in the client we can
fairly easily remove.

m


References