← Back to team overview

dhis2-users team mailing list archive

Re: [Dhis2-devs] Aggregation query builder details

 

Hi Lars

If not further work on the Aggregation query builder feature, *please don't
remove it*. We actually find it very useful and is critical to our
workflow. For example, we need to get Total patients seen in a facility.
Now with queries the user can see total figures, plus when needed segregate
them by age, gender, visit type (new,follow up etc.) and many more
categories in Pivot tables which provides a easy interface to suffice all
this.

Although it is possible to get these values through Program indicators,
there is no flexibility to see data by a certain category like with the
features that pivot table allow.

I have read other emails on the group that Aggregation query builder's
behavior is a bit unpredictable, but I haven't been able to produce any
errors yet, given we have heavy database and complicated queries.

Is it not possible to keep the Aggregation query feature as it is.

Thank you
Deepali






On Mon, Mar 14, 2016 at 10:10 PM, Lars Helge Øverland <lars@xxxxxxxxx>
wrote:

> Hi there,
>
> in fact, aggregation query builder is already scheduled to be removed in
> version 2.23 and will be replaced by program indicators. Admittedly there
> are a few cases where persisted aggregate event data could be useful,
> however we think that generating the aggregate values "on the fly" will
> provide more flexibility and be less of a load on the server by avoiding
> large, nightly batch jobs.
>
> The current aggregation query builder was not up to scratch and could have
> unpredictable behavior. At some point, we might use the program indicator
> engine as basis for supporting persistence of aggregated event data, but
> that is not top priority currently.
>
> We encourage you to try out the program indicators and provide feedback to
> the dev team.
>
> regards,
>
> Lars
>
>
>
>
>
>
>
>
>
> On Sun, Mar 13, 2016 at 1:28 PM, Uddin Fatema <fatemacse@xxxxxxxxx> wrote:
>
>> Dear All,
>>
>> We are facing same problem create an Aggregation query builder details as
>>  sum of data element value I put everything but it comes to Data element
>>  forsum/average/min/max ** **and try to select I can’t find anything and
>> this field is*
>>
>>
>>
>> mandatory and the data aggregation data element and tracker data element both
>> has sum aggregation
>>
>>
>> *Actually we cant to count Total Number of live birth from tracker
>> capture patient type data element.*
>>
>>
>> *How can I do it in program indicator ?*
>>
>>
>> *Thanks*
>>
>>
>> *Regards*
>>
>>
>> *Fatema*
>>
>> On Tue, Jan 5, 2016 at 5:21 PM, Ese Egerega <ese@xxxxxxxxxx> wrote:
>>
>>> Dear All,
>>>
>>> Am riding on Nami's question on aggregate query builder.
>>>
>>> I would like to know if there is a work around since the dropdown for
>>> "Data element for sum/average/min/max*" is not working in dhis2.21*
>>>
>>> We have a data element in tracker which records the quantity of drugs
>>> dispensed to patients during ANC visits. We would like to aggregate the
>>> total drug dispensed to a dataset so as to calculate things like maximum
>>> stock or quantity of drugs to order.
>>>
>>> Right now, am able to aggregate only the number of visits but not the
>>> actual drugs dispensed.
>>>
>>> I will appreciated any suggestions.
>>>
>>> Thanks,
>>> Ese
>>>
>>> On Fri, Nov 27, 2015 at 8:22 AM, Olav Poppe <olav.poppe@xxxxxx> wrote:
>>>
>>>> Hi,
>>>> just wanted to add my voice in support for improving (e.g. making it
>>>> faster and more reliable, supporting cohort analysis etc), rather than
>>>> removing the aggregation query builder. While I think the program
>>>> indicators are great, I think there are many cases where you would rather
>>>> want to store the aggregate data.
>>>>
>>>> One case I think is highly relevant (in the sense that countries are
>>>> doing it now) is where you have some facilities reporting via tracker and
>>>> other on paper/aggregate, and you would want the data to end up in the same
>>>> data elements/data sets.
>>>>
>>>> Olav
>>>>
>>>>
>>>>
>>>>
>>>> 26. nov. 2015 kl. 23.01 skrev Knut Staring <knutst@xxxxxxxxx>:
>>>>
>>>> Thanks for the clarifications, Elmarie and Dipali
>>>>
>>>> I think these are good inputs to our dev team, and hope some of them
>>>> will also chip into this conversation.
>>>>
>>>> Cheers,
>>>> Knut
>>>>
>>>> On Fri, Nov 27, 2015 at 4:11 AM, Elmarie Claasen <elmarie@xxxxxxxx>
>>>> wrote:
>>>>
>>>>> Hi Knut,
>>>>>
>>>>>
>>>>>
>>>>> Although I can see that program indicators can be helpful it has
>>>>> limited use in the context of interoperability between DHIS2 instances. In
>>>>> South Africa we feel that Survey type instances should be kept separate
>>>>> from Routine Health data collection and as such collect event or tracker
>>>>> data for surveys and would want to set up aggregated data elements in the
>>>>> system which populates with a stored aggregated data value which we
>>>>> export/synchronise with the routine HMIS system e.g.
>>>>>
>>>>> Patient satisfaction survey rate = No of surveys conducted/No of
>>>>> facilities
>>>>>
>>>>> Patient satisfaction rate = No of satisfied responses/All responses
>>>>>
>>>>>
>>>>>
>>>>> It is true that these aggregated elements can be populated with a
>>>>> function called via a sql view or cron job but not the most ideal.
>>>>>
>>>>> Up to now I have not figured out how to set up an indicator which
>>>>> counts if there was any surveys done in a specific period by adding a
>>>>> program indicator due to the limited amount of mathematical calculation
>>>>> formulae allowed in the Program Indicator engine.
>>>>>
>>>>>
>>>>>
>>>>> This said I must say that we don’t have much confidence in the
>>>>> accuracy of the Aggregation Query Builder as it is at the moment because
>>>>> there seems to be a ceiling limit on how many values can actually be
>>>>> inserted by running a scheduled or manual aggregation process and the
>>>>> simultaneous initiation of scheduled Aggregation Query builder and
>>>>> Analytics are problematic. For this reason we are checking the output of
>>>>> the Aggregation Query builder at this stage and when not entirely confident
>>>>> that it produces reliable results we are using functions instead.
>>>>>
>>>>>
>>>>>
>>>>> Regards,
>>>>>
>>>>>
>>>>>
>>>>> *Elmarie Claasen*
>>>>>
>>>>> <image001.png>
>>>>>
>>>>> Project Manager
>>>>>
>>>>> Health Information Systems Program
>>>>>
>>>>> Tel:      041-367 1027
>>>>>
>>>>> Cell:     082 374 2209
>>>>>
>>>>> E-mail: elmarie@xxxxxxxx
>>>>>
>>>>> Skype:  elmarie.claasen52
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> This message and any attachments are subject to a disclaimer published
>>>>> at http://www.hisp.org/policies.html#comms_disclaimer
>>>>> <http://www.hisp.org/policies.html#comms_disclaimer>.   Please read
>>>>> the disclaimer before opening any attachment or taking any other action in
>>>>> terms of this electronic transmission.
>>>>> If you cannot access the disclaimer, kindly send an email to
>>>>> disclaimer@xxxxxxxx  <disclaimer@xxxxxxxx>and a copy will be provided
>>>>> to you. By replying to this e-mail or opening any attachment you agree to
>>>>> be bound by the provisions of the disclaimer.
>>>>>
>>>>>
>>>>>
>>>>> *From:* Dhis2-users [mailto:dhis2-users-bounces+elmarie=
>>>>> hisp.org@xxxxxxxxxxxxxxxxxxx] *On Behalf Of *Dipali Sahu
>>>>> *Sent:* 26 November 2015 12:49 PM
>>>>> *To:* Knut Staring
>>>>> *Cc:* DHIS 2 Users list
>>>>> *Subject:* Re: [Dhis2-users] Aggregation query builder details
>>>>>
>>>>>
>>>>>
>>>>> Hi Knut
>>>>>
>>>>>
>>>>>
>>>>> We actually use Aggregation query builder to a large extent to get
>>>>> aggregated data. Exclusively, all our data is captured through Event
>>>>> capture, and we aggregate it through Aggregation query builder, so that the
>>>>> aggregated values can be shown in datasets as well as Pivot tables.
>>>>>
>>>>> Also, using Pivot tables with data elements is easier for the end
>>>>> users since they there is flexibility to can slice and dice the data with
>>>>> categories under Pivot tables.
>>>>>
>>>>>
>>>>>
>>>>> Don't you think aggregation with only program indicators will limit
>>>>> the use of categories and therefore easy visualization under pivot tables.
>>>>>
>>>>>
>>>>>
>>>>> Thank you
>>>>>
>>>>> Deepali
>>>>>
>>>>> International Medical Corps
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Wed, Nov 25, 2015 at 11:34 AM, Knut Staring <knutst@xxxxxxxxx>
>>>>> wrote:
>>>>>
>>>>> Hi Nami,
>>>>>
>>>>>
>>>>>
>>>>> Which version of DHIS2 are you working on? We are phasing out the
>>>>> aggregation query builder in favor of program indicators.
>>>>>
>>>>>
>>>>>
>>>>> Knut
>>>>>
>>>>>
>>>>>
>>>>> On Tue, Nov 24, 2015 at 5:45 PM, Nami Ghadri <nami_ghadri@xxxxxxxxxxx>
>>>>> wrote:
>>>>>
>>>>> Hello,
>>>>>
>>>>>
>>>>>
>>>>> I want to create an Aggregation query builder details as sum of data
>>>>> element value I put everything but it comes to Data element for
>>>>> sum/average/min/max ** **and try to select I can’t find anything and
>>>>> this field is *
>>>>>
>>>>>
>>>>>
>>>>> *mandatory and the data aggregator data element and tracker data
>>>>> element both has sum aggregator *
>>>>>
>>>>>
>>>>>
>>>>> *Any idea about this *
>>>>>
>>>>>
>>>>>
>>>>> *Thanks in advance*
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>>
>>>>> Knut Staring
>>>>>
>>>>> Dept. of Informatics, University of Oslo
>>>>>
>>>>> Norway: +4791880522
>>>>>
>>>>> Skype: knutstar
>>>>>
>>>>> http://dhis2.org
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>
>>>>>
>>>>>
>>>>> *This message and any attachments are subject to a disclaimer
>>>>> published at http://www.hisp.org/policies.html#comms_disclaimer
>>>>> <http://www.hisp.org/policies.html#comms_disclaimer>.  Please read the
>>>>> disclaimer before opening any attachment or taking any other action in
>>>>> terms of this electronic transmission.  If you cannot access the
>>>>> disclaimer, kindly send an email to disclaimer@xxxxxxxx
>>>>> <disclaimer@xxxxxxxx> and a copy will be provided to you. By replying to
>>>>> this e-mail or opening any attachment you agree to be bound by the
>>>>> provisions of the disclaimer.*
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Knut Staring
>>>> Dept. of Informatics, University of Oslo
>>>> Norway: +4791880522
>>>> Skype: knutstar
>>>> http://dhis2.org
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>> More help   : https://help.launchpad.net/ListHelp
>>>>
>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>> More help   : https://help.launchpad.net/ListHelp
>>>>
>>>>
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>>
>>
>> --
>> Regards,
>> *Fatema Uddin*
>>
>> Technical Advisor (HIS)-Support to the Health Sector Program II
>> Deutsche Gesellschaft für Internationale Zusammenarbeit (GIZ) GmbH
>> German House
>> House 10/A-2, Road 90
>> Gulshan 2, Dhaka 1212, Bangladesh
>>
>> T          +880 9666701000
>> F          +880 28823099
>> M         +880 19 6206 4712
>> I           www.giz.de
>> <https://owa.giz.de/owa/redir.aspx?C=mPQMujasE0-yL6Aa4ocPcnkcfUThJNEIi4h1DwsYjO3Ua20UR_COt6aTH1s4JIdR4p-jCoFsP6A.&URL=http%3a%2f%2fwww.giz.de%2f>
>>
>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~dhis2-users
>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~dhis2-users
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
> Lars Helge Øverland
> Lead developer, DHIS 2
> University of Oslo
> Skype: larshelgeoverland
> http://www.dhis2.org <https://www.dhis2.org/>
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-users
> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp
>
>

Follow ups

References