dhis2-users team mailing list archive

[Hannan Khan <hannank@xxxxxxxxx>]

Dear Moses

Please check the disk space available as Lars suggested and also check the
physical memory used and virtual memory used during analytic operation.

The possible reason of backup size difference is one with analytic and
data-mart tables and the other one without these tables or blank. The log
you share in your mail doesn't content any error log which does not lead to
a solution. Can you please share the tomcat log file for that specif time
period after when the backup is small.

Regards

Hannan Khan
HISP Bangladesh

On Tue, Nov 10, 2015 at 7:58 PM, Lars Helge Øverland <larshelge@xxxxxxxxx>
wrote:

> Sounds like an out of disk space issue. Perhaps verify that you have
> enough space on the partition you are storing the files on.
>
> On Tue, Nov 10, 2015 at 1:33 PM, Moses Marimo <marimo@xxxxxxxxx> wrote:
>
>> Hi Lars,
>>
>> I have seen where the problem was. Apparently, there is a scheduled
>> script that backs up the database. At some point, the size of the backup
>> file dropped from 2.3GB to 270MB. So, I was restoring this smaller file
>> while was definitely an incomplete file. I had to go back one week to get a
>> "healthy" looking backup file and it worked. So, there problem was not with
>> the DHIS2 software.
>>
>> Now, my currently problem is, why would a Postgresql backup file suddenly
>> fail that way, from 2.3GB to 270MB. I have tried to manually backup the
>> database and still same small backup file. The space on the server is about
>> 80% free space. I am using a pg_dump to backup the database on Ubuntu 14.04
>> LTS.
>>
>>
>>
>> On Mon, Nov 9, 2015 at 11:07 AM, Moses Marimo <marimo@xxxxxxxxx> wrote:
>>
>>> * INFO  2015-11-09 10:38:24,708 Indicator group set table generated (DefaultResourceTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:24,717 Create organisation unit group set table SQL: CREATE TABLE _organisationunitgroupsetstructure ( organisationunitid INTEGER NOT NULL, organisationunitname VARCHAR (250), "Location" VARCHAR (250), "NDAElbuYMNM" CHARACTER(11), "Ownership" VARCHAR (250), "Y2vBvfxaIcS" CHARACTER(11), "Type" VARCHAR (250), "fguPo20Ggjj" CHARACTER(11), PRIMARY KEY ( organisationunitid ) ) (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:24,719 Populate organisation unit group set structure SQL: insert into _organisationunitgroupsetstructure select ou.organisationunitid as organisationunitid, ou.name as organisationunitname, (select oug.name from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Location", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2034 where ougm.organisationunitid = ou.organisationunitid limit 1) as "NDAElbuYMNM", (select oug.name from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Ownership", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2032 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Y2vBvfxaIcS", (select oug.name from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "Type", (select oug.uid from orgunitgroup oug inner join orgunitgroupmembers ougm on ougm.orgunitgroupid = oug.orgunitgroupid inner join orgunitgroupsetmembers ougsm on ougsm.orgunitgroupid = ougm.orgunitgroupid and ougsm.orgunitgroupsetid = 2033 where ougm.organisationunitid = ou.organisationunitid limit 1) as "fguPo20Ggjj" from organisationunit ou (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:24,921 Organisation unit group set table generated (DefaultResourceTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:24,926 Create category structure table SQL: CREATE TABLE _categorystructure ( categoryoptioncomboid INTEGER NOT NULL, categoryoptioncomboname VARCHAR (250), PRIMARY KEY ( categoryoptioncomboid ) ) (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:24,928 Populate category structure SQL: insert into _categorystructure select coc.categoryoptioncomboid as cocid, con.categoryoptioncomboname as cocname from categoryoptioncombo coc inner join _categoryoptioncomboname con on coc.categoryoptioncomboid = con.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:24,930 Category table generated (DefaultResourceTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:27,657 Create data element structure SQL: CREATE TABLE _dataelementstructure ( dataelementid INTEGER NOT NULL PRIMARY KEY, dataelementuid CHARACTER(11), dataelementname VARCHAR(250), datasetid INTEGER, datasetuid CHARACTER(11), datasetname VARCHAR(250), datasetapprovallevel INTEGER, periodtypeid INTEGER, periodtypename VARCHAR(250) ) (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:32,651 Data element table generated (DefaultResourceTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:32,714 Create period structure SQL: CREATE TABLE _periodstructure (periodid INTEGER NOT NULL PRIMARY KEY, iso VARCHAR(15) NOT NULL, daysno INTEGER NOT NULL, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:32,750 Date period table generated (DefaultResourceTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:32,759 Create date period structure SQL: CREATE TABLE _dateperiodstructure (dateperiod DATE NOT NULL PRIMARY KEY, "daily" VARCHAR(15), "weekly" VARCHAR(15), "monthly" VARCHAR(15), "bimonthly" VARCHAR(15), "quarterly" VARCHAR(15), "sixmonthly" VARCHAR(15), "sixmonthlyapril" VARCHAR(15), "yearly" VARCHAR(15), "financialapril" VARCHAR(15), "financialjuly" VARCHAR(15), "financialoct" VARCHAR(15)) (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,029 Period table generated (DefaultResourceTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,030 Create data element category option combo SQL: CREATE TABLE _dataelementcategoryoptioncombo (dataelementid INTEGER NOT NULL, dataelementuid VARCHAR(11) NOT NULL, categoryoptioncomboid INTEGER NOT NULL, categoryoptioncombouid VARCHAR(11) NOT NULL) (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,032 Insert data element category option combo SQL: insert into _dataelementcategoryoptioncombo (dataelementid, dataelementuid, categoryoptioncomboid, categoryoptioncombouid) select de.dataelementid as dataelementid, de.uid as dataelementuid, coc.categoryoptioncomboid as categoryoptioncomboid, coc.uid as categoryoptioncombouid from dataelement de join categorycombos_optioncombos cc on de.categorycomboid = cc.categorycomboid join categoryoptioncombo coc on cc.categoryoptioncomboid = coc.categoryoptioncomboid (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,053 Create data element category option combo index SQL: CREATE INDEX dataelement_categoryoptioncombo ON _dataelementcategoryoptioncombo (dataelementuid, categoryoptioncombouid) (JdbcResourceTableStore.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,133 Data element category option combo table generated (DefaultResourceTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,143 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:37 CAT 2015, message: Updating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,144 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,145 Approval enabled: false (JdbcAnalyticsTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:37,145 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,156 Table update start: analytics, processes: 3, partitions: [analytics_2013, analytics_2014, analytics_2015], last years: null, earliest: null: 00:00:10.012 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,157 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,158 Performed pre-create table work: 00:00:10.013 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,158 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,165 Creating table: analytics_temp_2013, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,176 Creating table: analytics_temp_2014, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,184 Creating table: analytics_temp_2015, columns: 28 (JdbcAnalyticsTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,186 Created analytics tables: 00:00:10.042 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:38:47 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:38:47,187 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:40:29,977 Populated analytics_temp_2013, int: 102.79 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298])
>>> * INFO  2015-11-09 10:40:33,045 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298])
>>> * INFO  2015-11-09 10:40:36,108 Populated analytics_temp_2013, bool: 3.06 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298])
>>> * INFO  2015-11-09 10:40:39,159 Populated analytics_temp_2013, trueOnly: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298])
>>> * INFO  2015-11-09 10:40:55,434 Populated analytics_temp_2013, string: 16.27 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-298])
>>> * INFO  2015-11-09 10:41:09,059 Populated analytics_temp_2014, int: 141.87 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300])
>>> * INFO  2015-11-09 10:41:12,113 Populated analytics_temp_2014, bool: 3.05 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300])
>>> * INFO  2015-11-09 10:41:15,134 Populated analytics_temp_2014, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300])
>>> * INFO  2015-11-09 10:41:18,163 Populated analytics_temp_2014, trueOnly: 3.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300])
>>> * INFO  2015-11-09 10:41:34,466 Populated analytics_temp_2014, string: 16.30 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-300])
>>> * INFO  2015-11-09 10:41:38,998 Populated analytics_temp_2015, int: 171.80 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299])
>>> * INFO  2015-11-09 10:41:42,023 Populated analytics_temp_2015, bool: 3.02 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299])
>>> * INFO  2015-11-09 10:41:45,019 Populated analytics_temp_2015, bool: 2.99 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299])
>>> * INFO  2015-11-09 10:41:48,024 Populated analytics_temp_2015, trueOnly: 3.00 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299])
>>> * INFO  2015-11-09 10:42:04,402 Populated analytics_temp_2015, string: 16.37 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-299])
>>> * INFO  2015-11-09 10:42:04,403 Populated analytics tables: 00:03:27.258 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:42:04,403 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:42:04,405 Applied aggregation levels: 00:03:27.260 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:42:04,405 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:42:04 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:42:04,406 No of analytics table indexes: 84 (DefaultAnalyticsTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:10,245 Created indexes: 00:08:33.100 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:10,245 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:10,246 Vacuumed tables: 00:08:33.102 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:10,246 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:10 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,133 Partition tables: [analytics_2013, analytics_2014, analytics_2015], last years: null: 00:08:33.989 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,133 Table update done: analytics: 00:08:33.989 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,134 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Updating completeness table] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,135 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,136 Get tables using earliest: null (AbstractJdbcTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,166 Table update start: analytics_completeness, processes: 3, partitions: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null, earliest: null: 00:00:00.030 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,167 Performed pre-create table work: 00:00:00.031 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,167 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,170 Creating table: analytics_completeness_temp_2013, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,173 Creating table: analytics_completeness_temp_2014, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,177 Creating table: analytics_completeness_temp_2015, columns: 20 (JdbcCompletenessTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,179 Created analytics tables: 00:00:00.043 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,179 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,179 Populate table task number: 3 (DefaultAnalyticsTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,198 Populated analytics_completeness_temp_2013: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-308])
>>> * INFO  2015-11-09 10:47:11,287 Populated analytics_completeness_temp_2015: 0.10 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-309])
>>> * INFO  2015-11-09 10:47:11,304 Populated analytics_completeness_temp_2014: 0.12 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-307])
>>> * INFO  2015-11-09 10:47:11,304 Populated analytics tables: 00:00:00.168 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,304 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,305 Applied aggregation levels: 00:00:00.169 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,306 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:11 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:11,306 No of analytics table indexes: 60 (DefaultAnalyticsTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,132 Created indexes: 00:00:02.996 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,132 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,133 Vacuumed tables: 00:00:02.997 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,133 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,187 Partition tables: [analytics_completeness_2013, analytics_completeness_2014, analytics_completeness_2015], last years: null: 00:00:03.051 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,187 Table update done: analytics_completeness: 00:00:03.051 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,187 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating completeness target table] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,188 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,189 Table update start: analytics_completenesstarget, processes: 3, partitions: [analytics_completenesstarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,189 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,189 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,192 Creating table: analytics_completenesstarget_temp, columns: 9 (JdbcCompletenessTargetTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,193 Created analytics tables: 00:00:00.004 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,193 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,193 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,225 Populated analytics_completenesstarget_temp: 0.03 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-316])
>>> * INFO  2015-11-09 10:47:14,226 Populated analytics tables: 00:00:00.037 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,226 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,227 Applied aggregation levels: 00:00:00.038 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,227 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,228 No of analytics table indexes: 9 (DefaultAnalyticsTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,673 Created indexes: 00:00:00.484 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,673 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,674 Vacuumed tables: 00:00:00.485 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,674 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,687 Partition tables: [analytics_completenesstarget], last years: null: 00:00:00.499 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,688 Table update done: analytics_completenesstarget: 00:00:00.499 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,688 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating organisation unit target table] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,689 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,689 Table update start: analytics_orgunittarget, processes: 3, partitions: [analytics_orgunittarget], last years: null, earliest: null: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Performing pre-create table work, processes: 3, org unit levels: 5] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,690 Performed pre-create table work: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,690 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,692 Creating table: analytics_orgunittarget_temp, columns: 6 (JdbcOrgUnitTargetTableManager.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,693 Created analytics tables: 00:00:00.003 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,693 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Populating analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,693 Populate table task number: 1 (DefaultAnalyticsTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,705 Populated analytics_orgunittarget_temp: 0.01 seconds (AbstractJdbcTableManager.java [SimpleAsyncTaskExecutor-323])
>>> * INFO  2015-11-09 10:47:14,706 Populated analytics tables: 00:00:00.016 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,706 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Applying aggregation levels] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,707 Applied aggregation levels: 00:00:00.017 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,707 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Creating indexes] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,707 No of analytics table indexes: 6 (DefaultAnalyticsTableService.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,809 Created indexes: 00:00:00.120 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,809 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Vacuuming tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,810 Vacuumed tables: 00:00:00.121 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,811 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Swapping analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,821 Partition tables: [analytics_orgunittarget], last years: null: 00:00:00.131 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Clearing caches] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,821 Table update done: analytics_orgunittarget: 00:00:00.131 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Table update done] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,821 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Updating event analytics table] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,822 Starting update, processes: 3, org unit levels: 5: 00:00:00.000 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,822 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: No events exist, not updating event analytics tables] (InMemoryNotifier.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,823 Analytics tables updated: 00:08:54.947 (Clock.java [taskScheduler-5])
>>> * INFO  2015-11-09 10:47:14,823 [Level: INFO, category: DATAMART, time: Mon Nov 09 10:47:14 CAT 2015, message: Analytics tables updated: 00:08:54.947] (InMemoryNotifier.java [taskScheduler-5])
>>>
>>>
>>> On Sat, Nov 7, 2015 at 10:54 AM, Lars Helge Øverland <
>>> larshelge@xxxxxxxxx> wrote:
>>>
>>>> Hi Moses,
>>>>
>>>> can you please share the tomcat log output during analytics table
>>>> generation.
>>>>
>>>> regards,
>>>>
>>>> Lars
>>>>
>>>>
>>>>
>>>> On Fri, Nov 6, 2015 at 4:31 PM, Moses Marimo <marimo@xxxxxxxxx> wrote:
>>>>
>>>>> I am running DHIS2.20 on Ubuntu LTS 14.04 with Tomcat 7
>>>>>
>>>>>
>>>>> On Friday, 6 November 2015, Moses Marimo <marimo@xxxxxxxxx> wrote:
>>>>>
>>>>>> After I restored a database, analytics table is no longer being
>>>>>> populated even if after running Analytics, rebooting server, running
>>>>>> analytics again. I have checked in physical datavalue table and the data is
>>>>>> there. No error in Catalina logs.
>>>>>>
>>>>>> Any pointers??
>>>>>>
>>>>>>
>>>>>> --
>>>>>> ICT Warehouse (Pvt) Ltd - "The Stockist of *e*-nnovation"
>>>>>> 7 Chelmsford Belgravia, Harare
>>>>>> Tel: +263-8644-102349
>>>>>> Cell: +263-772-268353
>>>>>> Website: *www.ict.co.zw <http://www.ict.co.zw>*
>>>>>>
>>>>>>
>>>>>> Innovative solutions in Web Design and E-Commerce, Software
>>>>>> Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing,
>>>>>> General ICT Solutions and Consultancy.
>>>>>>
>>>>>>
>>>>>
>>>>> --
>>>>> ICT Warehouse (Pvt) Ltd - "The Stockist of *e*-nnovation"
>>>>> 7 Chelmsford Belgravia, Harare
>>>>> Tel: +263-8644-102349
>>>>> Cell: +263-772-268353
>>>>> Website: *www.ict.co.zw <http://www.ict.co.zw>*
>>>>>
>>>>>
>>>>> Innovative solutions in Web Design and E-Commerce, Software
>>>>> Engineering, Mobile and Bulk SMS Solutions, Graphic Design and Printing,
>>>>> General ICT Solutions and Consultancy.
>>>>>
>>>>>
>>>>> _______________________________________________
>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Lars Helge Øverland
>>>> Lead developer, DHIS 2
>>>> University of Oslo
>>>> Skype: larshelgeoverland
>>>> http://www.dhis2.org <https://www.dhis2.org>
>>>>
>>>>
>>>
>>>
>>> --
>>> ICT Warehouse (Pvt) Ltd - "The Stockist of *e*-nnovation"
>>> 7 Chelmsford Belgravia, Harare
>>> Tel: +263-8644-102349
>>> Cell: +263-772-268353
>>> Website: *www.ict.co.zw <http://www.ict.co.zw>*
>>>
>>>
>>> Innovative solutions in Web Design and E-Commerce, Software Engineering,
>>> Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT
>>> Solutions and Consultancy.
>>>
>>
>>
>>
>> --
>> ICT Warehouse (Pvt) Ltd - "The Stockist of *e*-nnovation"
>> 7 Chelmsford Belgravia, Harare
>> Tel: +263-8644-102349
>> Cell: +263-772-268353
>> Website: *www.ict.co.zw <http://www.ict.co.zw>*
>>
>>
>> Innovative solutions in Web Design and E-Commerce, Software Engineering,
>> Mobile and Bulk SMS Solutions, Graphic Design and Printing, General ICT
>> Solutions and Consultancy.
>>
>
>
>
> --
> Lars Helge Øverland
> Lead developer, DHIS 2
> University of Oslo
> Skype: larshelgeoverland
> http://www.dhis2.org <https://www.dhis2.org>
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-users
> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp
>
>