← Back to team overview

launchpad-dev team mailing list archive

Re: generic job queue cronjob?

 

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

On 09/27/2010 10:54 AM, Julian Edwards wrote:
> On Monday 27 September 2010 14:51:32 Aaron Bentley wrote:
>> On 09/27/2010 07:26 AM, Julian Edwards wrote:
>>> I firmly believe that restricting it to a task dispatching system will
>>> limit what we can do, so I agree.
>>
>> I generally see limiting scope as a good thing, not a bad thing, so I
>> don't agree with your conclusion.
> 
> My conclusion is little to do with limiting the scope of building a task 
> system.  It is everything to do with building a scalable and fast Launchpad.

I thought "it" referred to the task dispatch system work.  I get you now.

> However, since it is likely that we'll be using a messaging 
> system to manage the tasks, I'd be extremely upset if you implemented it so 
> that its features can't be used outside of the new job system.

Sure.

> I have already explained that I want to use message passing in some of my 
> pipelined processing and I don't want to use the Job API to do this, partly 
> because it has been an utter disaster trying to bend the API for the build 
> farm to use it

I am sorry that using the Job API has been a problem for you.  I would
appreciate feedback on how we can improve it.  I don't want you having
to bend it.

>, and partly because modelling everything as a job is not useful 
> when all we want is a simple event.

We will have to examine this use case in greater detail at some point,
because so far, I don't understand why you wouldn't want a Job.

Aaron
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iEYEARECAAYFAkygsxoACgkQ0F+nu1YWqI3beACffwcHb2V8+0E8DaSTGSWOjY2n
ik0AniYMSzw392DOMUSHBuTiI1m4M6CO
=QNpG
-----END PGP SIGNATURE-----



Follow ups

References