dhis2-devs team mailing list archive

[Orvalho Augusto <orvaquim@xxxxxxxxx>]

I understood that you want since I click on the create resource tables.

This is what since tomcat starts begin  I have:
===========================================================
Jul 14, 2010 6:41:14 PM org.apache.catalina.core.AprLifecycleListener init
INFO: The APR based Apache Tomcat Native library which allows optimal
performance in production environments was not found on the
java.library.path: /home/jfclere/jakarta-tomcat-co
nnectors/jni/native/.libs
Jul 14, 2010 6:41:14 PM org.apache.coyote.http11.Http11Protocol init
INFO: Initializing Coyote HTTP/1.1 on http-6080
Jul 14, 2010 6:41:14 PM org.apache.catalina.startup.Catalina load
INFO: Initialization processed in 750 ms
Jul 14, 2010 6:41:14 PM org.apache.catalina.core.StandardService start
INFO: Starting service Catalina
Jul 14, 2010 6:41:14 PM org.apache.catalina.core.StandardEngine start
INFO: Starting Servlet Engine: Apache Tomcat/6.0.18
Jul 14, 2010 6:41:14 PM org.apache.catalina.startup.HostConfig deployWAR
INFO: Deploying web application archive dhis.war
Jul 14, 2010 6:41:16 PM org.apache.catalina.core.ApplicationContext log
INFO: Initializing Spring root WebApplicationContext
* INFO  18:41:28,013 System property dhis2.home not set
(DefaultLocationManager.java [main])
* INFO  18:41:28,026 Environment variable DHIS2_HOME points to
/home/tomcatjason (DefaultLocationManager.java [main])
 > orderByFragment(order-by)
  > sortSpecification({sort specification})
   > sortKeySpecification(sort key)
    > sortKey($PlaceHolder$.stageinprogram)
    < sortKey(null)
   < sortKeySpecification(null)
  < sortSpecification(null)
 < orderByFragment(null)
 > orderByFragment(order-by)
  > sortSpecification({sort specification})
   > sortKeySpecification(sort key)
    > sortKey($PlaceHolder$.stageinprogram)
    < sortKey(null)
   < sortKeySpecification(null)
  < sortSpecification(null)
 < orderByFragment(null)
 > orderByFragment(order-by)
  > sortSpecification({sort specification})
   > sortKeySpecification(sort key)
    > sortKey($PlaceHolder$.sortorder)
    < sortKey(null)
   < sortKeySpecification(null)
  < sortSpecification(null)
 < orderByFragment(null)
* INFO  18:41:59,621 Executing startup routine [1 of 11, runlevel 1]:
TableAlteror (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:00,555 Tables updated (TableAlteror.java [main])
* INFO  18:42:00,580 Executing startup routine [2 of 11, runlevel 2]:
PeriodTypePopulator (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:00,651 Executing startup routine [3 of 11, runlevel 3]:
TableCreator (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:00,718 Table aggregateddatavalue exists (TableCreator.java
[main])
* INFO  18:42:00,721 Table aggregatedindicatorvalue exists
(TableCreator.java [main])
* INFO  18:42:00,724 Index crosstab exists on table datavalue
(TableCreator.java [main])
* INFO  18:42:00,727 Table aggregateddatasetcompleteness exists
(TableCreator.java [main])
* INFO  18:42:00,730 Table datavaluearchive exists (TableCreator.java
[main])
* INFO  18:42:00,730 Executing startup routine [4 of 11, runlevel 3]:
DataElementDefaultDimensionPopulator (DefaultStartupRoutineExecutor.java
[main])
* INFO  18:42:03,355 Executing startup routine [5 of 11, runlevel 3]:
MultiDimensionExpressionUpgrader (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:03,392 Executing startup routine [6 of 11, runlevel 5]:
DataSetShortNamePopulator (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:03,428 Populated DataSet short name and code
(DataSetShortNamePopulator.java [main])
* INFO  18:42:03,429 Executing startup routine [7 of 11, runlevel 5]:
UuidPopulator (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:03,434 Checked CategoryOption uuids (UuidPopulator.java
[main])
* INFO  18:42:03,439 Checked Category uuids (UuidPopulator.java [main])
* INFO  18:42:04,887 Checked DataElement uuids (UuidPopulator.java [main])
* INFO  18:42:04,888 Executing startup routine [8 of 11, runlevel 5]:
OrganisationUnitGroupSetPopulator (DefaultStartupRoutineExecutor.java
[main])
* INFO  18:42:04,898 Executing startup routine [9 of 11, runlevel 5]:
DataEntryFormPopulator (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:04,899 Removing datasetid column from dataentryform table
(DataEntryFormPopulator.java [main])
* INFO  18:42:04,903 Executing startup routine [10 of 11, runlevel 6]:
OpenHealthDataSourceWriter (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:04,904 Environment variable OPENHEALTH_HOME not set
(OpenHealthDataSourceWriter.java [main])
* INFO  18:42:04,904 Executing startup routine [11 of 11, runlevel 8]:
I18nUpgrader (DefaultStartupRoutineExecutor.java [main])
* INFO  18:42:05,365 All startup routines done
(DefaultStartupRoutineExecutor.java [main])
Jul 14, 2010 6:42:13 PM org.apache.catalina.core.ApplicationContext log
INFO: ContextListener: contextInitialized()
Jul 14, 2010 6:42:13 PM org.apache.catalina.core.ApplicationContext log
INFO: SessionListener: contextInitialized()
Jul 14, 2010 6:42:13 PM org.apache.coyote.http11.Http11Protocol start
INFO: Starting Coyote HTTP/1.1 on http-6080
Jul 14, 2010 6:42:13 PM org.apache.jk.common.ChannelSocket init
INFO: Port busy 7009 java.net.BindException: Address already in use
Jul 14, 2010 6:42:13 PM org.apache.jk.common.ChannelSocket init
INFO: JK: ajp13 listening on /0.0.0.0:7010
Jul 14, 2010 6:42:13 PM org.apache.jk.server.JkMain start
INFO: Jk running ID=1 time=0/37  config=null
Jul 14, 2010 6:42:13 PM org.apache.catalina.startup.Catalina start
INFO: Server startup in 58789 ms
* INFO  18:43:45,108 User login success: 'admin'
(DefaultUserAuditService.java [http-6080-2])
* INFO  18:56:39,905 User login success: 'admin'
(DefaultUserAuditService.java [http-6080-3])
========================================================================

See guys I am starting to feel bad. I am noticing problems that none is
reporting neither confirm. So I admit there is something wrong with me...
should I search a medical help? :-|

Caveman







On Wed, Jul 14, 2010 at 7:06 PM, Jason Pickering <
jason.p.pickering@xxxxxxxxx> wrote:

> Hi Caveman,
> Not doubting you but I have not seen DHIS start without some more
> information.
> You see nothing similar to this when DHIS starts up?
>
> * INFO  11:15:58,359 Executing startup routine [1 of 13, runlevel 0]:
> DataSetSho
> rtNamePopulator (DefaultStartupRoutineExecutor.java [main])
> * INFO  11:15:58,529 Populated DataSet short name and code
> (DataSetShortNamePopu
> lator.java [main])
> * INFO  11:15:58,529 Executing startup routine [2 of 13, runlevel 0]:
> UuidPopula
> tor (DefaultStartupRoutineExecutor.java [main])
> * INFO  11:15:58,536 Checked CategoryOption uuids (UuidPopulator.java
> [main])
> * INFO  11:15:58,543 Checked Category uuids (UuidPopulator.java [main])
> * INFO  11:15:58,561 Checked DataElement uuids (UuidPopulator.java [main])
> * INFO  11:15:58,561 Executing startup routine [3 of 13, runlevel 0]:
> Organisati
> onUnitHierarchyVerifier (DefaultStartupRoutineExecutor.java [main])
> ....
>
> When you replaced the DHIS war file, did you also remove the dhis directory
> (rm -rf dhis) ?
>
> Regards,
> Jason
>
>
>
>
> On Wed, Jul 14, 2010 at 6:24 PM, Orvalho Augusto <orvaquim@xxxxxxxxx>wrote:
>
>> I am saying the truth.
>>
>> This is what I have on my catalina.out:
>> * INFO  16:31:50,284 User login success: 'admin'
>> (DefaultUserAuditService.java [http-8081-3])
>> Jul 14, 2010 4:31:50 PM org.apache.velocity.runtime.log.JdkLogChute log
>> SEVERE: #parse() null argument
>>
>> Caveman
>>
>>
>>
>> On Wed, Jul 14, 2010 at 5:35 PM, Jason Pickering <
>> jason.p.pickering@xxxxxxxxx> wrote:
>>
>>> Hi Caveman,
>>> There must be something being logged in apache-tomcat-X.X.XX/logs
>>> directory. Open up a terminal, and then do tail -f catalina.out and in a
>>> separate terminal, start Tomcat. Post the result and we may be able to help.
>>>
>>>
>>> Let me know if something is not clear.
>>>
>>> Regards,
>>> Jason
>>>
>>>
>>>
>>> On Wed, Jul 14, 2010 at 4:40 PM, Orvalho Augusto <orvaquim@xxxxxxxxx>wrote:
>>>
>>>> There is nothing being logged.
>>>>
>>>> There are no views.
>>>>
>>>> Caveman
>>>>
>>>>
>>>>
>>>> On Wed, Jul 14, 2010 at 9:03 AM, Jason Pickering <
>>>> jason.p.pickering@xxxxxxxxx> wrote:
>>>>
>>>>> Hi Caveman,
>>>>>
>>>>> Can you please post a stack trace of your application (use
>>>>> pastebin.com)  from startup until you start the datamart/report table
>>>>> process?
>>>>>
>>>>> Do you have any external views that are linked to the report table you
>>>>> are attempting to aggregate?
>>>>>
>>>>> Regards,
>>>>> Jason
>>>>>
>>>>>
>>>>> On Wed, Jul 14, 2010 at 8:57 AM, Orvalho Augusto <orvaquim@xxxxxxxxx>
>>>>> wrote:
>>>>> > And even do those resource tables on Postgres it does not aggregate.
>>>>> >
>>>>> > Caveman
>>>>> >
>>>>> > On Wed, Jul 14, 2010 at 6:35 AM, Orvalho Augusto <orvaquim@xxxxxxxxx>
>>>>> wrote:
>>>>> >>
>>>>> >> I have changed the database (from MySQL to Postgres)... and used
>>>>> DHIS
>>>>> >> tools to export and import the data.
>>>>> >>
>>>>> >> Well, those resource tables are being built in seconds on Postgres
>>>>> now. So
>>>>> >> I think there is a bug with MySQL. And I want to help to correct it.
>>>>> >>
>>>>> >> One verry bad consequence of not importing the dataelementids is:
>>>>> The
>>>>> >> entering forms does not work no more. We have to redesign the forms
>>>>> after an
>>>>> >> import.
>>>>> >>
>>>>> >> Caveman
>>>>> >>
>>>>> >>
>>>>> >> On Tue, Jul 13, 2010 at 10:28 PM, Orvalho Augusto <
>>>>> orvaquim@xxxxxxxxx>
>>>>> >> wrote:
>>>>> >>>
>>>>> >>> Ok.
>>>>> >>>
>>>>> >>>
>>>>> >>> On Tue, Jul 13, 2010 at 11:55 AM, Bob Jolliffe <
>>>>> bobjolliffe@xxxxxxxxx>
>>>>> >>> wrote:
>>>>> >>>>
>>>>> >>>> On 13 July 2010 07:17, Orvalho Augusto <orvaquim@xxxxxxxxx>
>>>>> wrote:
>>>>> >>>> > I recompiled DHIS2.05 yesterday with help of a magician Jason
>>>>> >>>> > yesterday. And
>>>>> >>>> > the first thing I tried was this aggregation thing.
>>>>> >>>> >
>>>>> >>>> > So I started redoing the orgunitstructure. It gave the same
>>>>> error.
>>>>> >>>> >
>>>>> >>>> > While it was running I used the
>>>>> >>>> > show full processlist
>>>>> >>>> > to find out that it is a verry long insert to be run at once. I
>>>>> have
>>>>> >>>> > 1664
>>>>> >>>> > orgunits. So it sounds like indexing trouble.
>>>>> >>>> >
>>>>> >>>> > As there is a faith and "antimysql fight" I am moving my data to
>>>>> >>>> > postgres. I
>>>>> >>>> > have to do it manually.
>>>>> >>>>
>>>>> >>>> There is no mysql fight. Just more people using postgres I guess.
>>>>> >>>>
>>>>> >>>> >
>>>>> >>>> > I have to do it manually because DHIS does not keep de ids fixed
>>>>> >>>> > (organisationunid, dataelementid etc). That affects our mapping
>>>>> data
>>>>> >>>> > for
>>>>> >>>> > data importation from other systems. So if someone could suggest
>>>>> a
>>>>> >>>> > good
>>>>> >>>> > strategy is welcomed.
>>>>> >>>>
>>>>> >>>> How are you doing mapping data from other systems?  If you tell me
>>>>> a
>>>>> >>>> bit about these systems and the data they have maybe we can make a
>>>>> >>>> plan :-)
>>>>> >>>
>>>>> >>> Basically these systems are:
>>>>> >>> The dataset (the DHIS  concept) is represented by a table (in
>>>>> EpiInfo
>>>>> >>> 6.06, DBF or MSAccess) where each record should have a month (or
>>>>> week or
>>>>> >>> quarter), year, province, district and health center columns -
>>>>> sometimes
>>>>> >>> they place the name of the association or a special sector of the
>>>>> health
>>>>> >>> center - then the other columns define a dataelement for DHIS.
>>>>> >>>
>>>>> >>> So what we were doing is:
>>>>> >>> 1. Migrate the data from anywhere (EpiInfo, MSAccess and DBF) to
>>>>> MySQL.
>>>>> >>>
>>>>> >>> 2. On MySQL we have tables where the columns names of those tables
>>>>> >>> mapping to the dataelementid (which Lars recommend not be like
>>>>> this)
>>>>> >>>
>>>>> >>> 3. There is a script on Python made to run routinely to process
>>>>> this data
>>>>> >>> and insert the new one on DHIS 2 tables.
>>>>> >>> When I say routinely, I mean each month or whenever I want it.
>>>>> >>>
>>>>> >>> The objective were to use solely DHIS for report and one day for
>>>>> data
>>>>> >>> entry.
>>>>> >>>
>>>>> >>> Caveman
>>>>> >>>
>>>>> >>>>
>>>>> >>>> Cheers
>>>>> >>>> Bob
>>>>> >>>>
>>>>> >>>> >
>>>>> >>>> > Thanks for your patience guys
>>>>> >>>> > Caveman
>>>>> >>>> >
>>>>> >>>> >
>>>>> >>>> >
>>>>> >>>> >
>>>>> >>>> >
>>>>> >>>> > 2010/7/12 Jason Pickering <jason.p.pickering@xxxxxxxxx>
>>>>> >>>> >>
>>>>> >>>> >> Hi Lars,
>>>>> >>>> >> Well, yes and no. If the resource tables (namely
>>>>> orgunitstructure) is
>>>>> >>>> >> not generated, it would not be possible to assign any orgunits
>>>>> to a
>>>>> >>>> >> given data mart/report table? Likewise, if the orgunit levels
>>>>> have
>>>>> >>>> >> not
>>>>> >>>> >> been defined, it is also not possible to assign any orgunits to
>>>>> a
>>>>> >>>> >> given report table/datamart, or perhaps I am just hallucinating
>>>>> ? I
>>>>> >>>> >> have run into this problem several times actually when creating
>>>>> new
>>>>> >>>> >> databases. Ideally, the orgunitstructure table should be
>>>>> regenerated
>>>>> >>>> >> when there have been changes to the orgunit hierarchy and users
>>>>> >>>> >> should
>>>>> >>>> >> be warned that it is not possible to create a report
>>>>> table/datamart
>>>>> >>>> >> without first defining orgunit level names.
>>>>> >>>> >>
>>>>> >>>> >> Regards,
>>>>> >>>> >> Jason
>>>>> >>>> >>
>>>>> >>>> >>
>>>>> >>>> >> 2010/7/12 Lars Helge Øverland <larshelge@xxxxxxxxx>:
>>>>> >>>> >> > Generating any of the resource tables don't affect the
>>>>> aggregation
>>>>> >>>> >> > /
>>>>> >>>> >> > report tables...
>>>>> >>>> >> >
>>>>> >>>> >> >
>>>>> >>>> >> >
>>>>> >>>> >> > On Sun, Jul 11, 2010 at 5:36 PM, Orvalho Augusto
>>>>> >>>> >> > <orvaquim@xxxxxxxxx>
>>>>> >>>> >> > wrote:
>>>>> >>>> >> >> Thanks!!!
>>>>> >>>> >> >>
>>>>> >>>> >> >> Caveman
>>>>> >>>> >> >>
>>>>> >>>> >> >>
>>>>> >>>> >> >> On Sun, Jul 11, 2010 at 5:03 PM, Jason Pickering
>>>>> >>>> >> >> <jason.p.pickering@xxxxxxxxx> wrote:
>>>>> >>>> >> >>>
>>>>> >>>> >> >>> A very common mistake is not having generated the resource
>>>>> >>>> >> >>> tables,
>>>>> >>>> >> >>> namely "orgunitstructure". Consult the documentation for
>>>>> more
>>>>> >>>> >> >>> details
>>>>> >>>> >> >>> on how to generate these tables.
>>>>> >>>> >> >>>
>>>>> >>>> >> >>> Regards,
>>>>> >>>> >> >>> Jason
>>>>> >>>> >> >>>
>>>>> >>>> >> >>>
>>>>> >>>> >> >>> On Sun, Jul 11, 2010 at 4:27 PM, Orvalho Augusto
>>>>> >>>> >> >>> <orvaquim@xxxxxxxxx>
>>>>> >>>> >> >>> wrote:
>>>>> >>>> >> >>> > I have a dataelement collected at a Health Centre level
>>>>> (eg:
>>>>> >>>> >> >>> > ats_posfem)
>>>>> >>>> >> >>> > in
>>>>> >>>> >> >>> > one province and only in some particular districts. In
>>>>> >>>> >> >>> > unpredictible
>>>>> >>>> >> >>> > future
>>>>> >>>> >> >>> > at National level we will be collecting on every health
>>>>> centre.
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > Now, my ignorance: How can I obtain the provincial total
>>>>> on
>>>>> >>>> >> >>> > Report
>>>>> >>>> >> >>> > Table? I
>>>>> >>>> >> >>> > have been battled with DHIS so far and nothing.
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > Thanks guys
>>>>> >>>> >> >>> > Caveman
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> > _______________________________________________
>>>>> >>>> >> >>> > Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>>>>> >>>> >> >>> > Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>> >>>> >> >>> > Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>>>>> >>>> >> >>> > More help   : https://help.launchpad.net/ListHelp
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>> >
>>>>> >>>> >> >>>
>>>>> >>>> >> >>>
>>>>> >>>> >> >>>
>>>>> >>>> >> >>> --
>>>>> >>>> >> >>> --
>>>>> >>>> >> >>> Jason P. Pickering
>>>>> >>>> >> >>> email: jason.p.pickering@xxxxxxxxx
>>>>> >>>> >> >>> tel:+260968395190
>>>>> >>>> >> >>
>>>>> >>>> >> >>
>>>>> >>>> >> >>
>>>>> >>>> >> >>
>>>>> >>>> >> >> _______________________________________________
>>>>> >>>> >> >> Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>>>>> >>>> >> >> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>> >>>> >> >> Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>>>>> >>>> >> >> More help   : https://help.launchpad.net/ListHelp
>>>>> >>>> >> >>
>>>>> >>>> >> >>
>>>>> >>>> >> >
>>>>> >>>> >>
>>>>> >>>> >>
>>>>> >>>> >>
>>>>> >>>> >> --
>>>>> >>>> >> --
>>>>> >>>> >> Jason P. Pickering
>>>>> >>>> >> email: jason.p.pickering@xxxxxxxxx
>>>>> >>>> >> tel:+260968395190
>>>>> >>>> >
>>>>> >>>> >
>>>>> >>>> >
>>>>> >>>> > _______________________________________________
>>>>> >>>> > Mailing list: https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>>>>> >>>> > Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>> >>>> > Unsubscribe : https://launchpad.net/~dhis2-devs<https://launchpad.net/%7Edhis2-devs>
>>>>> >>>> > More help   : https://help.launchpad.net/ListHelp
>>>>> >>>> >
>>>>> >>>> >
>>>>> >>>
>>>>> >>>
>>>>> >>
>>>>> >>
>>>>> >
>>>>> >
>>>>> >
>>>>> >
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> --
>>>>> Jason P. Pickering
>>>>> email: jason.p.pickering@xxxxxxxxx
>>>>> tel:+260968395190
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> --
>>> Jason P. Pickering
>>> email: jason.p.pickering@xxxxxxxxx
>>> tel:+260968395190
>>>
>>
>>
>>
>>
>
>
> --
> --
> Jason P. Pickering
> email: jason.p.pickering@xxxxxxxxx
> tel:+260968395190
>