← Back to team overview

dhis2-devs team mailing list archive

Re: Controlling datamart scheduling

 

Triggering of the datamart can be accomplished using Curl pretty
simply in fact with something like


 curl "http://apps.dhis2.org/dev/dhis-web-reporting/startExport.action?startDate=2011-01-01&endDate=2012-06-11&periodType=Weekly";
-u admin:district -v

What is a bit perplexing is the AJAX requests which happen after the
process starts.

Every second something like

GET /dhis/dhis-web-commons-ajax-json/getNotifications.action?category=DATAMART&lastUid=lnRDYj19kNI

gets triggered to update the AJAX window which displays the progress
of the datamart, as of course you know. What is a bit puzzling is
where these UID come from? Of course, it would be nice to parse all of
the data which comes back from the server, just a bit unsure how to
start to parse it from the command line.

Anyway, this solves the immediate problem of how to trigger the data
mart process at a time other than what the scheduler can do at the
moment.


Regards,
Jason


On Mon, Jun 11, 2012 at 9:26 AM, Jason Pickering
<jason.p.pickering@xxxxxxxxx> wrote:
> I suppose we could do this with CURL fairly easily?
>
> Here is the request I think
>
>  "GET /dhis/dhis-web-reporting/startExport.action?startDate=2011-01-01&endDate=2012-06-11&periodType=Weekly&periodType=Monthly&periodType=Yearly
> HTTP/1.1" 200
>
> Any thoughts?
>
> Regards,
> Jason
>
>
> On Sun, Jun 10, 2012 at 11:28 PM, Bob Jolliffe <bobjolliffe@xxxxxxxxx> wrote:
>> On 10 June 2012 21:38, Morten Olav Hansen <mortenoh@xxxxxxxxx> wrote:
>>>> 2) The ability to trigger the datamart through a call to the WebAPI.
>>>> You seem to hint that this is possible, but I am not sure how to do
>>>> it. If it is, then it solves my problem, as I can use use a simple
>>>> script to start Server 1 at a certain time and Server 2 at another
>>>> time. There may be other needs for external systems to request a data
>>>> mart job however.
>>>
>>> This is currently not possible.
>>
>> I am quite sure there used to be a url which did this, but not part of
>> the new web api stuff,
>>
>>>
>>> --
>>> Morten
>>>
>>>> I will try and work this into at least one blueprint (UI for Datamart
>>>> scheduling). Not sure about the second point. Maybe it is already
>>>> possible?
>>>>
>>>> Regards,
>>>> Jason
>>>>
>>>>
>>>> On Wed, Jun 6, 2012 at 11:29 AM, Ola Hodne Titlestad <olati@xxxxxxxxxx> wrote:
>>>>> (just got Knut's email, sending anyway...)
>>>>>
>>>>> For a shorter term solution, wouldn't it be possible to trigger the manual
>>>>> datamart job with two dates (and possibly a list of period types) through
>>>>> the web-api?
>>>>>
>>>>> Time setup/cron jobs would be handled outside DHIS in this case.
>>>>>
>>>>> Ola
>>>>> -----
>>>>>
>>>>> ----------------------------------
>>>>> Ola Hodne Titlestad (Mr)
>>>>> HISP
>>>>> Department of Informatics
>>>>> University of Oslo
>>>>>
>>>>> Mobile: +47 48069736
>>>>> Home address: Vetlandsvn. 95B, 0685 Oslo, Norway. Googlemaps link
>>>>>
>>>>>
>>>>>
>>>>> On 6 June 2012 11:12, Lars Helge Øverland <larshelge@xxxxxxxxx> wrote:
>>>>>>
>>>>>> Okay. Problem is the scheduling implementation does not support custom
>>>>>> time setups / cron expressiosn well.. so it will be a bit of work.
>>>>>> Feel free to write a blueprint.
>>>>>>
>>>>>> On Tue, Jun 5, 2012 at 8:47 PM, Jason Pickering
>>>>>> <jason.p.pickering@xxxxxxxxx> wrote:
>>>>>> > Just thinking aloud, but since the introduction of 2.8,there is not much
>>>>>> > to
>>>>>> > parameterize. Would just like to be able to trigger the set data mart
>>>>>> > task
>>>>>> > with a cron job based on a particular circumstance, for instance a time
>>>>>> > or
>>>>>> > particular event . This could be extended to the resource tables as well
>>>>>> > which often need to be regenerated by for instance the addition of a new
>>>>>> > organization unit.
>>>>>> >
>>>>>> > --
>>>>>> > Sent from my mobile
>>>>>> >
>>>>>> > On Jun 5, 2012 8:26 PM, "Lars Helge Øverland" <larshelge@xxxxxxxxx>
>>>>>> > wrote:
>>>>>> >>
>>>>>> >> Expose triggering of data mart exports through the web api sounds
>>>>>> >> useful. What kind of interface (input params) to the process would be
>>>>>> >> most useful?
>>>>>> >>
>>>>>> >> On Tue, Jun 5, 2012 at 8:04 PM, Jason Pickering
>>>>>> >> <jason.p.pickering@xxxxxxxxx> wrote:
>>>>>> >> > Hmm. Sounds messy as there are a number of other scheduled jobs which
>>>>>> >> > I
>>>>>> >> > normally run after the data mart. Another possibility would be be to
>>>>>> >> > trigger
>>>>>> >> > this though the WebAPI.
>>>>>> >> >
>>>>>> >> > Would this be possible with a custom version and if so could you
>>>>>> >> > point
>>>>>> >> > me to
>>>>>> >> > what I need to modify?
>>>>>> >> >
>>>>>> >> > --
>>>>>> >> > Sent from my mobile
>>>>>> >> >
>>>>>> >> > On Jun 5, 2012 7:48 PM, "Lars Helge Øverland" <larshelge@xxxxxxxxx>
>>>>>> >> > wrote:
>>>>>> >> >>
>>>>>> >> >> Hi Jason,
>>>>>> >> >>
>>>>>> >> >> sorry there is no proper way of doing this through the system at the
>>>>>> >> >> moment. I think we can include this functionality. As a work-around
>>>>>> >> >> you can set the server clock a few hours forward, start/stop
>>>>>> >> >> scheduling on your second server, then set the server clock back.
>>>>>> >> >>
>>>>>> >> >> Lars
>>>>>> >> >>
>>>>>> >> >>
>>>>>> >> >> On Tue, Jun 5, 2012 at 5:54 PM, Jason Pickering
>>>>>> >> >> <jason.p.pickering@xxxxxxxxx> wrote:
>>>>>> >> >> > Hi there Devs.
>>>>>> >> >> >
>>>>>> >> >> > I have two separate instances of DHIS2 (version 2.8) on the same
>>>>>> >> >> > server. I would like to be able to control the times at which the
>>>>>> >> >> > data
>>>>>> >> >> > mart executes, so that the processes are not competing for
>>>>>> >> >> > resources.
>>>>>> >> >> > Is there anyway to do this, short of a recompile?
>>>>>> >> >> >
>>>>>> >> >> > Best regards,
>>>>>> >> >> > Jason
>>>>>> >> >> >
>>>>>> >> >> > _______________________________________________
>>>>>> >> >> > Mailing list: https://launchpad.net/~dhis2-devs
>>>>>> >> >> > Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>>> >> >> > Unsubscribe : https://launchpad.net/~dhis2-devs
>>>>>> >> >> > More help   : https://help.launchpad.net/ListHelp
>>>>>>
>>>>>> _______________________________________________
>>>>>> Mailing list: https://launchpad.net/~dhis2-devs
>>>>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-devs
>>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help   : https://help.launchpad.net/ListHelp


References