dhis2-users team mailing list archive

[Jason Pickering <jason.p.pickering@xxxxxxxxx>]

Why not ever 1 nanosecond? Its always going to take some amount of time,
question is what is reasonable.

One could argue that real-time analytics in an aggregate data system is not
needed. This is not real time data. Its not even close to it.
Look at Google Analytics. They provide reports once a day, and you do not
see a whole lot of people complaning. Yes, you can get some limited real
time information from this as well, but its limited. The data must be
processed first, and that takes computational time. Same with DHIS2.

>From my experience, people think they need "real time analytics" when they
really are just in a rush.  Data takes time to review and analayze and
whether its available now, 1 nanosecond from now, or 10 minutes from now,
makes no difference in the end, as the amount of time which is required to
digest that information is on a totally different time scale (hours days or
weeks). Once an hour is probably easily achievable depending on the scale
of the system however.

As for the call to the API, just create a Bash script and call it as
frequently as you like with a cron task.

This is a very simple one, but you should really check for things like "Is
analytics already running and should I trigger another run?"

#!/bin/sh

/usr/bin/curl
"localhost:8080/api/resourceTables/analytics?skipResourceTables=true&lastYears=2"
-X POST -u admin:district >/dev/null 2>&1




On Fri, Apr 22, 2016 at 1:34 PM, Morten Olav Hansen <morten@xxxxxxxxx>
wrote:

> Well, it sounds like a bad solution for me ;) if every 10 min works fine..
> why not every 5 min.. why not every 1 min..
>
> --
> Morten Olav Hansen
> Senior Engineer, DHIS 2
> University of Oslo
> http://www.dhis2.org
>
> On Fri, Apr 22, 2016 at 6:31 PM, Ibrahim Bayoh <
> ibrahim.bayoh@xxxxxxxxxxxxxxxxxxxx> wrote:
>
>> @Jason,Knut and Morten, Having analytics table run every 10 mins sounds
>> like a good place to start. but am kind of not sure how to implement this
>> with the API calls and am sure this is not possible through the user
>> interface. If you guys can point me in the right direction with an example
>> of some sort that will greatly helpful and highly appreciated.
>>
>> Thanks.
>>
>> On Fri, Apr 22, 2016 at 11:23 AM, Jason Pickering <
>> jason.p.pickering@xxxxxxxxx> wrote:
>>
>>> No they are swapped now, so first they are built as temp tables, then
>>> swapped. So, this is the brief point in time in which things may not be
>>> available.
>>>
>>> Every 10 minutes might be OK, depending on your server, loading, and
>>> amount of data. It just requires some experimentation.
>>>
>>> Point is, "real time" analytics is not possible. Near-real time may be.
>>>
>>> On Fri, Apr 22, 2016 at 1:03 PM, Morten Olav Hansen <morten@xxxxxxxxx>
>>> wrote:
>>>
>>>> But I thought all analytic tables was cleared out during re-generation?
>>>> is this not true?
>>>>
>>>> --
>>>> Morten Olav Hansen
>>>> Senior Engineer, DHIS 2
>>>> University of Oslo
>>>> http://www.dhis2.org
>>>>
>>>> On Fri, Apr 22, 2016 at 6:00 PM, Knut Staring <knutst@xxxxxxxxx> wrote:
>>>>
>>>>> Depends on the data. I trigger analytics every 10 min.
>>>>> Hi All,
>>>>> Initially i thought DHIS2 had fully or out-of-the-box  realtime
>>>>> analytics and Dashboards. But after further inspection i realized that
>>>>> current data entry will not available for analysis or dashboards until the
>>>>> next day or by manually doing export tables.  This is a real bottle neck to
>>>>> the intended implementation am working on. I have looked at Scheduling, but
>>>>> the options for analytics table is not ideal in my case. *Is there
>>>>> way this can be reduced or removed to gain real-time dashboards and
>>>>> analytics?*
>>>>>
>>>>> Thanks,
>>>>> Bayoh.
>>>>>
>>>>> --
>>>>> Ibrahim Rashid Bayoh
>>>>> Information Systems Coordinator,
>>>>> eHealth Africa(Sierra Leone)
>>>>> *117 Wilkinson Rd, Freetown, Sierra Leone*
>>>>> Mobile: +232 88-765-638
>>>>> ibrahim.bayoh@xxxxxxxxxxxxxxxxxxxx
>>>>> http://ehealthafrica.org/
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>
>>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>> More help   : https://help.launchpad.net/ListHelp
>>>>
>>>>
>>>
>>>
>>> --
>>> Jason P. Pickering
>>> email: jason.p.pickering@xxxxxxxxx
>>> tel:+46764147049
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-users
>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>>
>>
>> --
>> Ibrahim Rashid Bayoh
>> Information Systems Coordinator,
>> eHealth Africa(Sierra Leone)
>> *117 Wilkinson Rd, Freetown, Sierra Leone*
>> Mobile: +232 88-765-638
>> ibrahim.bayoh@xxxxxxxxxxxxxxxxxxxx
>> http://ehealthafrica.org/
>>
>>
>


-- 
Jason P. Pickering
email: jason.p.pickering@xxxxxxxxx
tel:+46764147049