dhis2-devs team mailing list archive

[Calle Hedberg <calle.hedberg@xxxxxxxxx>]

Hi

I've had this "exception during execution" failures happening many times,
with a multitude of reasons. In general, it's caused by either a data issue
- some data is "discrepant" compared to the meta-data - or it can be caused
by meta-data discrepancies (some times temporary).

The last time I had it - for the Sierra Leone HMIS last week - a simple use
of Maintenance->Reload apps fixed it.

In other cases I've fixed it by manually deleting all the resource tables
(those starting with _ in the name) and re-creating them by using
Maintenance->Resource tables (your _periodstructure table might contain
some rubbish)

I've also had cases where deleting all analytics tables and resource tables
and then re-start fixed the problem.

If _periodstructure contains garbage, it might originate from the period
table - so check that too (sort on periodtype, and ensure that all records
have start/end dates coherent with the periodtype)

Regards
calle



On 5 June 2018 at 14:00, Knut Staring <knutst@xxxxxxxxx> wrote:

> I encountered exactly the same bug, but shamefully did not report, just
> coped with it by removing data older than 2014 as I did not need it.
>
> Knut
>
> On Tue, Jun 5, 2018 at 1:58 PM Bob Jolliffe <bobjolliffe@xxxxxxxxx> wrote:
>
>> Hi Kumar
>>
>> That does indeed look like a bug.  In which case you should create a jira
>> issue.
>>
>> I am just a little surprised that there is nobody else with weekly data
>> from 2012/2013 reporting the same problem.  That would be good to confirm.
>>
>> Bob
>>
>> On 5 June 2018 at 11:34, Kumar Shahdeo <gauravns@xxxxxxxxxxxxxxxx> wrote:
>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> *Thanks for the inputs Gerald. I have made the changes in postgres conf
>>> file. However, I was still facing the same issues.I was looking into the
>>> server logs and I have following analysis : - When we run analytics,
>>> ANALYTICS_TABLE is created which is clear from this log message [Level:
>>> INFO, category: ANALYTICS_TABLE, time: Tue Jun 05 09:51:34 UTC 2018,
>>> message: Creating analytics tables]- Once this table is created, we get log
>>> message as : Creating partition table: analytics_temp_2012- This table has
>>> a constraint on column ‘yearly’ :  “analytics_temp_2012_yearly_check" CHECK
>>> (yearly = '2012'::text)- Values are inserted into these table by extracting
>>> rows using a sql query. This sql query does an inner join with
>>> ‘_periodstructure’ table- One of the rows that was getting inserted into
>>> table ‘analytics_temp_2012’ contains following values (this list does not
>>> include all the
>>> columns)biweekly2013BiW0monthly201301bimonthly201301Bquarterly2013Q1sixmonthly2013S1sixmonthlyapril2012AprilS2yearly2013financialapril2012Aprilfinancialjuly2012Julyfinancialoct2012Octstartdate2012-12-31enddate2013-01-06year2012
>>> - Here we can see that if the week starts on 2012(‘startdate’ column has
>>> value 31-12-2012(dd-mm-yyyy)) and ends on 2013(‘enddate’ is 06-01-2012),
>>> and majority of days for that week falls in 2013. Then the value for column
>>> ‘yearly’ is populated as ‘2013’, while the constraint applied on column
>>> expects it to be ‘2012’.This seems to be bug on DHIS. Can you please
>>> confirm this.*
>>> Regards
>>> Gaurav
>>>
>>> On Tue, Jun 5, 2018 at 3:57 PM, gerald thomas <gerald17006@xxxxxxxxx>
>>> wrote:
>>>
>>>> Kumar,
>>>> Any update?
>>>>
>>>> On Tue, Jun 5, 2018 at 9:14 AM, gerald thomas <gerald17006@xxxxxxxxx>
>>>> wrote:
>>>>
>>>>> Kumar,
>>>>> Kindly change the following on your postgresql.conf:
>>>>> shared_buffers = 2120 MB
>>>>> effective_cache_size = 5300 MB
>>>>>
>>>>> Then do:
>>>>> sudo service postgres restart
>>>>>
>>>>> And run analytics again
>>>>>
>>>>> On Tue, Jun 5, 2018 at 8:58 AM, Kumar Shahdeo <
>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>
>>>>>> Yes, its 8 GB
>>>>>>
>>>>>> On Tue, Jun 5, 2018 at 2:13 PM, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>> wrote:
>>>>>>
>>>>>>> Kumar,
>>>>>>> What is the RAM size of this server, Is it 8BG?
>>>>>>>
>>>>>>> On Tue, Jun 5, 2018 at 6:39 AM, Kumar Shahdeo <
>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>
>>>>>>>> I am using Postgres 9.4 . Please find the attached postgres conf
>>>>>>>> file
>>>>>>>>
>>>>>>>> On Tue, Jun 5, 2018 at 11:24 AM, gerald thomas <
>>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>>
>>>>>>>>> Dear Kumar,
>>>>>>>>> What version of Postgres are running? Normally, these errors
>>>>>>>>> occurs when the postgres.conf is not configured properly based on the data
>>>>>>>>> size it has to analyzed.
>>>>>>>>> Please can you send your Postgres.conf file.
>>>>>>>>>
>>>>>>>>> On Tue, 5 Jun 2018 at 05:40, Kumar Shahdeo <
>>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>
>>>>>>>>>> Yes, I rebooted the server, but still I am getting the same issue
>>>>>>>>>> while running analytics
>>>>>>>>>>
>>>>>>>>>> On Tue, Jun 5, 2018 at 10:52 AM, gerald thomas <
>>>>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>
>>>>>>>>>>> Dear Kumar,
>>>>>>>>>>> Have you tried to reboot the server after upgrades and then run
>>>>>>>>>>> analytics again?
>>>>>>>>>>>
>>>>>>>>>>> On Tue, 5 Jun 2018 at 04:49, Kumar Shahdeo <
>>>>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Hi DHIS users,
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> I have migrated from DHIS 2.27 to DHIS 2.29. I used the upgrade
>>>>>>>>>>>> script provided by DHIS to upgrade the db. I have tried both incremental
>>>>>>>>>>>> upgrade (2.27->2.28->2.29) and skipping 2.28(2.27->2.29). In both the cases
>>>>>>>>>>>> I am getting the same issue.
>>>>>>>>>>>>
>>>>>>>>>>>> I am not able to run analytics. Analytics fails with below
>>>>>>>>>>>> error(captured in screenshot)
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> When I checked server logs. I got this exception :
>>>>>>>>>>>>
>>>>>>>>>>>> org.springframework.dao.DataIntegrityViolationException with
>>>>>>>>>>>> error message ‘new row for relation "analytics_temp_2012" violates check
>>>>>>>>>>>> constraint "analytics_temp_2012,_yearly_check”’
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> Any suggestions on this will be highly appreciated.
>>>>>>>>>>>>
>>>>>>>>>>>> Regards
>>>>>>>>>>>> --
>>>>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>>>>> Developer
>>>>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Regards,
>>>>>>>>>>>
>>>>>>>>>>> Gerald
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>>> Developer
>>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Regards,
>>>>>>>>>
>>>>>>>>> Gerald
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>> Developer
>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>> [image: ThoughtWorks]
>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Regards,
>>>>>>>
>>>>>>> Gerald
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>> Developer
>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>> [image: ThoughtWorks]
>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Regards,
>>>>>
>>>>> Gerald
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Regards,
>>>>
>>>> Gerald
>>>>
>>>
>>>
>>>
>>> --
>>> Kumar Gaurav Nath Shahdeo
>>> Developer
>>> Email gauravns@xxxxxxxxxxxxxxxx
>>> Telephone +91 9160688935 <+91+9160688935>
>>> [image: ThoughtWorks]
>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-users
>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~dhis2-users
>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~dhis2-users
>> More help   : https://help.launchpad.net/ListHelp
>>
>
>
> --
> Knut Staring
>
> Department of Information, Evidence and Research
> World Health Organization, Geneva, Switzerland
> Office: +41 22 791 3683 Mob1: +33 6 4434 2931 Mob2: +47 9188 0522
> Skype:     knutstar
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp
>
>


-- 

*******************************************

Calle Hedberg

46D Alma Road, 7700 Rosebank, SOUTH AFRICA

Tel/fax (home): +27-21-685-6472

Cell: +27-82-853-5352

Iridium SatPhone: +8816-315-19119

Email: calle.hedberg@xxxxxxxxx

Skype: calle_hedberg

*******************************************