launchpad-dev team mailing list archive
-
launchpad-dev team
-
Mailing list archive
-
Message #04766
Re: generic job queue cronjob?
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1
On 09/23/2010 07:05 PM, Ian Booth wrote:
>>
>> Here are a few things I have lined up that could be done via rabbit:
>> -Send oops reports to lp-oops immediately rather than later.
>> -Trigger completion of long-poll paused requests on appservers.
>> -raise traps when things like the queue retry limit trigger
>>
>
> And another from me:
>
> - things like the branch scan job or diff generation when a merge
> proposal is created, plus other similar examples
I was looking for examples of uses of messaging outside task dispatch.
Branch scan and diff generation fall squarely under task dispatch. They
are exactly the sort of thing I was already considering, not something I
hadn't thought of.
I would absolutely love those to become more responsive, and I think
that messaging is the right underlying technology, but they're entirely
in scope for
https://dev.launchpad.net/Foundations/NewTaskSystem/Requirements
> Basically, workflow which is currently implemented using cron jobs and
> database updates as essentially the task trigger mechanism should be
> migrate to a solution based on message queues IMHO.
I don't know that message *queues* per se are necessary. Transient
messaging ala Twisted AMP could also work, and would let us continue to
access job data using our familiar tools and libraries.
Aaron
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/
iEYEARECAAYFAkyb5FIACgkQ0F+nu1YWqI2TVgCfdShRHDQNcKxRhZD+RM533vnx
NCkAn0Jv/2IU7Sq98e4cLJ9GadzTpi/c
=jeCK
-----END PGP SIGNATURE-----
Follow ups
References