← Back to team overview

dhis2-devs team mailing list archive

Re: Aggregating values

 

I have changed the database (from MySQL to Postgres)... and used DHIS tools
to export and import the data.

Well, those resource tables are being built in seconds on Postgres now. So I
think there is a bug with MySQL. And I want to help to correct it.

One verry bad consequence of not importing the dataelementids is: The
entering forms does not work no more. We have to redesign the forms after an
import.

Caveman


On Tue, Jul 13, 2010 at 10:28 PM, Orvalho Augusto <orvaquim@xxxxxxxxx>wrote:

> Ok.
>
>
> On Tue, Jul 13, 2010 at 11:55 AM, Bob Jolliffe <bobjolliffe@xxxxxxxxx>wrote:
>
>> On 13 July 2010 07:17, Orvalho Augusto <orvaquim@xxxxxxxxx> wrote:
>> > I recompiled DHIS2.05 yesterday with help of a magician Jason yesterday.
>> And
>> > the first thing I tried was this aggregation thing.
>> >
>> > So I started redoing the orgunitstructure. It gave the same error.
>> >
>> > While it was running I used the
>> > show full processlist
>> > to find out that it is a verry long insert to be run at once. I have
>> 1664
>> > orgunits. So it sounds like indexing trouble.
>> >
>> > As there is a faith and "antimysql fight" I am moving my data to
>> postgres. I
>> > have to do it manually.
>>
>> There is no mysql fight. Just more people using postgres I guess.
>>
>
>> >
>> > I have to do it manually because DHIS does not keep de ids fixed
>> > (organisationunid, dataelementid etc). That affects our mapping data for
>> > data importation from other systems. So if someone could suggest a good
>> > strategy is welcomed.
>>
>> How are you doing mapping data from other systems?  If you tell me a
>> bit about these systems and the data they have maybe we can make a
>> plan :-)
>>
> Basically these systems are:
> The dataset (the DHIS  concept) is represented by a table (in EpiInfo 6.06,
> DBF or MSAccess) where each record should have a month (or week or quarter),
> year, province, district and health center columns - sometimes they place
> the name of the association or a special sector of the health center - then
> the other columns define a dataelement for DHIS.
>
> So what we were doing is:
> 1. Migrate the data from anywhere (EpiInfo, MSAccess and DBF) to MySQL.
>
> 2. On MySQL we have tables where the columns names of those tables mapping
> to the dataelementid (which Lars recommend not be like this)
>
> 3. There is a script on Python made to run routinely to process this data
> and insert the new one on DHIS 2 tables.
> When I say routinely, I mean each month or whenever I want it.
>
> The objective were to use solely DHIS for report and one day for data
> entry.
>
> Caveman
>
>
>> Cheers
>> Bob
>>
>> >
>> > Thanks for your patience guys
>> > Caveman
>> >
>> >
>> >
>> >
>> >
>> > 2010/7/12 Jason Pickering <jason.p.pickering@xxxxxxxxx>
>> >>
>> >> Hi Lars,
>> >> Well, yes and no. If the resource tables (namely orgunitstructure) is
>> >> not generated, it would not be possible to assign any orgunits to a
>> >> given data mart/report table? Likewise, if the orgunit levels have not
>> >> been defined, it is also not possible to assign any orgunits to a
>> >> given report table/datamart, or perhaps I am just hallucinating ? I
>> >> have run into this problem several times actually when creating new
>> >> databases. Ideally, the orgunitstructure table should be regenerated
>> >> when there have been changes to the orgunit hierarchy and users should
>> >> be warned that it is not possible to create a report table/datamart
>> >> without first defining orgunit level names.
>> >>
>> >> Regards,
>> >> Jason
>> >>
>> >>
>> >> 2010/7/12 Lars Helge Øverland <larshelge@xxxxxxxxx>:
>> >> > Generating any of the resource tables don't affect the aggregation /
>> >> > report tables...
>> >> >
>> >> >
>> >> >
>> >> > On Sun, Jul 11, 2010 at 5:36 PM, Orvalho Augusto <orvaquim@xxxxxxxxx
>> >
>> >> > wrote:
>> >> >> Thanks!!!
>> >> >>
>> >> >> Caveman
>> >> >>
>> >> >>
>> >> >> On Sun, Jul 11, 2010 at 5:03 PM, Jason Pickering
>> >> >> <jason.p.pickering@xxxxxxxxx> wrote:
>> >> >>>
>> >> >>> A very common mistake is not having generated the resource tables,
>> >> >>> namely "orgunitstructure". Consult the documentation for more
>> details
>> >> >>> on how to generate these tables.
>> >> >>>
>> >> >>> Regards,
>> >> >>> Jason
>> >> >>>
>> >> >>>
>> >> >>> On Sun, Jul 11, 2010 at 4:27 PM, Orvalho Augusto <
>> orvaquim@xxxxxxxxx>
>> >> >>> wrote:
>> >> >>> > I have a dataelement collected at a Health Centre level (eg:
>> >> >>> > ats_posfem)
>> >> >>> > in
>> >> >>> > one province and only in some particular districts. In
>> unpredictible
>> >> >>> > future
>> >> >>> > at National level we will be collecting on every health centre.
>> >> >>> >
>> >> >>> > Now, my ignorance: How can I obtain the provincial total on
>> Report
>> >> >>> > Table? I
>> >> >>> > have been battled with DHIS so far and nothing.
>> >> >>> >
>> >> >>> > Thanks guys
>> >> >>> > Caveman
>> >> >>> >
>> >> >>> >
>> >> >>> > _______________________________________________
>> >> >>> > Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>> >> >>> > Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>> >> >>> > Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>> >> >>> > More help   : https://help.launchpad.net/ListHelp
>> >> >>> >
>> >> >>> >
>> >> >>>
>> >> >>>
>> >> >>>
>> >> >>> --
>> >> >>> --
>> >> >>> Jason P. Pickering
>> >> >>> email: jason.p.pickering@xxxxxxxxx
>> >> >>> tel:+260968395190
>> >> >>
>> >> >>
>> >> >>
>> >> >>
>> >> >> _______________________________________________
>> >> >> Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>> >> >> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>> >> >> Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>> >> >> More help   : https://help.launchpad.net/ListHelp
>> >> >>
>> >> >>
>> >> >
>> >>
>> >>
>> >>
>> >> --
>> >> --
>> >> Jason P. Pickering
>> >> email: jason.p.pickering@xxxxxxxxx
>> >> tel:+260968395190
>> >
>> >
>> >
>> > _______________________________________________
>> > Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>> > Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>> > Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>> > More help   : https://help.launchpad.net/ListHelp
>> >
>> >
>>
>
>
>

Follow ups

References