← Back to team overview

dhis2-devs team mailing list archive

Re: Aggregating values

 

Ok.


On Tue, Jul 13, 2010 at 11:55 AM, Bob Jolliffe <bobjolliffe@xxxxxxxxx>wrote:

> On 13 July 2010 07:17, Orvalho Augusto <orvaquim@xxxxxxxxx> wrote:
> > I recompiled DHIS2.05 yesterday with help of a magician Jason yesterday.
> And
> > the first thing I tried was this aggregation thing.
> >
> > So I started redoing the orgunitstructure. It gave the same error.
> >
> > While it was running I used the
> > show full processlist
> > to find out that it is a verry long insert to be run at once. I have 1664
> > orgunits. So it sounds like indexing trouble.
> >
> > As there is a faith and "antimysql fight" I am moving my data to
> postgres. I
> > have to do it manually.
>
> There is no mysql fight. Just more people using postgres I guess.
>

> >
> > I have to do it manually because DHIS does not keep de ids fixed
> > (organisationunid, dataelementid etc). That affects our mapping data for
> > data importation from other systems. So if someone could suggest a good
> > strategy is welcomed.
>
> How are you doing mapping data from other systems?  If you tell me a
> bit about these systems and the data they have maybe we can make a
> plan :-)
>
Basically these systems are:
The dataset (the DHIS  concept) is represented by a table (in EpiInfo 6.06,
DBF or MSAccess) where each record should have a month (or week or quarter),
year, province, district and health center columns - sometimes they place
the name of the association or a special sector of the health center - then
the other columns define a dataelement for DHIS.

So what we were doing is:
1. Migrate the data from anywhere (EpiInfo, MSAccess and DBF) to MySQL.

2. On MySQL we have tables where the columns names of those tables mapping
to the dataelementid (which Lars recommend not be like this)

3. There is a script on Python made to run routinely to process this data
and insert the new one on DHIS 2 tables.
When I say routinely, I mean each month or whenever I want it.

The objective were to use solely DHIS for report and one day for data entry.

Caveman


> Cheers
> Bob
>
> >
> > Thanks for your patience guys
> > Caveman
> >
> >
> >
> >
> >
> > 2010/7/12 Jason Pickering <jason.p.pickering@xxxxxxxxx>
> >>
> >> Hi Lars,
> >> Well, yes and no. If the resource tables (namely orgunitstructure) is
> >> not generated, it would not be possible to assign any orgunits to a
> >> given data mart/report table? Likewise, if the orgunit levels have not
> >> been defined, it is also not possible to assign any orgunits to a
> >> given report table/datamart, or perhaps I am just hallucinating ? I
> >> have run into this problem several times actually when creating new
> >> databases. Ideally, the orgunitstructure table should be regenerated
> >> when there have been changes to the orgunit hierarchy and users should
> >> be warned that it is not possible to create a report table/datamart
> >> without first defining orgunit level names.
> >>
> >> Regards,
> >> Jason
> >>
> >>
> >> 2010/7/12 Lars Helge Øverland <larshelge@xxxxxxxxx>:
> >> > Generating any of the resource tables don't affect the aggregation /
> >> > report tables...
> >> >
> >> >
> >> >
> >> > On Sun, Jul 11, 2010 at 5:36 PM, Orvalho Augusto <orvaquim@xxxxxxxxx>
> >> > wrote:
> >> >> Thanks!!!
> >> >>
> >> >> Caveman
> >> >>
> >> >>
> >> >> On Sun, Jul 11, 2010 at 5:03 PM, Jason Pickering
> >> >> <jason.p.pickering@xxxxxxxxx> wrote:
> >> >>>
> >> >>> A very common mistake is not having generated the resource tables,
> >> >>> namely "orgunitstructure". Consult the documentation for more
> details
> >> >>> on how to generate these tables.
> >> >>>
> >> >>> Regards,
> >> >>> Jason
> >> >>>
> >> >>>
> >> >>> On Sun, Jul 11, 2010 at 4:27 PM, Orvalho Augusto <
> orvaquim@xxxxxxxxx>
> >> >>> wrote:
> >> >>> > I have a dataelement collected at a Health Centre level (eg:
> >> >>> > ats_posfem)
> >> >>> > in
> >> >>> > one province and only in some particular districts. In
> unpredictible
> >> >>> > future
> >> >>> > at National level we will be collecting on every health centre.
> >> >>> >
> >> >>> > Now, my ignorance: How can I obtain the provincial total on Report
> >> >>> > Table? I
> >> >>> > have been battled with DHIS so far and nothing.
> >> >>> >
> >> >>> > Thanks guys
> >> >>> > Caveman
> >> >>> >
> >> >>> >
> >> >>> > _______________________________________________
> >> >>> > Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
> >> >>> > Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> >> >>> > Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
> >> >>> > More help   : https://help.launchpad.net/ListHelp
> >> >>> >
> >> >>> >
> >> >>>
> >> >>>
> >> >>>
> >> >>> --
> >> >>> --
> >> >>> Jason P. Pickering
> >> >>> email: jason.p.pickering@xxxxxxxxx
> >> >>> tel:+260968395190
> >> >>
> >> >>
> >> >>
> >> >>
> >> >> _______________________________________________
> >> >> Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
> >> >> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> >> >> Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
> >> >> More help   : https://help.launchpad.net/ListHelp
> >> >>
> >> >>
> >> >
> >>
> >>
> >>
> >> --
> >> --
> >> Jason P. Pickering
> >> email: jason.p.pickering@xxxxxxxxx
> >> tel:+260968395190
> >
> >
> >
> > _______________________________________________
> > Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
> > Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> > Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
> > More help   : https://help.launchpad.net/ListHelp
> >
> >
>

Follow ups

References