← Back to team overview

dhis2-users team mailing list archive

Re: Error while running analytics in 2.29

 

I encountered exactly the same bug, but shamefully did not report, just
coped with it by removing data older than 2014 as I did not need it.

Knut

On Tue, Jun 5, 2018 at 1:58 PM Bob Jolliffe <bobjolliffe@xxxxxxxxx> wrote:

> Hi Kumar
>
> That does indeed look like a bug.  In which case you should create a jira
> issue.
>
> I am just a little surprised that there is nobody else with weekly data
> from 2012/2013 reporting the same problem.  That would be good to confirm.
>
> Bob
>
> On 5 June 2018 at 11:34, Kumar Shahdeo <gauravns@xxxxxxxxxxxxxxxx> wrote:
>
>>
>>
>>
>>
>>
>>
>>
>> *Thanks for the inputs Gerald. I have made the changes in postgres conf
>> file. However, I was still facing the same issues.I was looking into the
>> server logs and I have following analysis : - When we run analytics,
>> ANALYTICS_TABLE is created which is clear from this log message [Level:
>> INFO, category: ANALYTICS_TABLE, time: Tue Jun 05 09:51:34 UTC 2018,
>> message: Creating analytics tables]- Once this table is created, we get log
>> message as : Creating partition table: analytics_temp_2012- This table has
>> a constraint on column ‘yearly’ :  “analytics_temp_2012_yearly_check" CHECK
>> (yearly = '2012'::text)- Values are inserted into these table by extracting
>> rows using a sql query. This sql query does an inner join with
>> ‘_periodstructure’ table- One of the rows that was getting inserted into
>> table ‘analytics_temp_2012’ contains following values (this list does not
>> include all the
>> columns)biweekly2013BiW0monthly201301bimonthly201301Bquarterly2013Q1sixmonthly2013S1sixmonthlyapril2012AprilS2yearly2013financialapril2012Aprilfinancialjuly2012Julyfinancialoct2012Octstartdate2012-12-31enddate2013-01-06year2012
>> - Here we can see that if the week starts on 2012(‘startdate’ column has
>> value 31-12-2012(dd-mm-yyyy)) and ends on 2013(‘enddate’ is 06-01-2012),
>> and majority of days for that week falls in 2013. Then the value for column
>> ‘yearly’ is populated as ‘2013’, while the constraint applied on column
>> expects it to be ‘2012’.This seems to be bug on DHIS. Can you please
>> confirm this.*
>> Regards
>> Gaurav
>>
>> On Tue, Jun 5, 2018 at 3:57 PM, gerald thomas <gerald17006@xxxxxxxxx>
>> wrote:
>>
>>> Kumar,
>>> Any update?
>>>
>>> On Tue, Jun 5, 2018 at 9:14 AM, gerald thomas <gerald17006@xxxxxxxxx>
>>> wrote:
>>>
>>>> Kumar,
>>>> Kindly change the following on your postgresql.conf:
>>>> shared_buffers = 2120 MB
>>>> effective_cache_size = 5300 MB
>>>>
>>>> Then do:
>>>> sudo service postgres restart
>>>>
>>>> And run analytics again
>>>>
>>>> On Tue, Jun 5, 2018 at 8:58 AM, Kumar Shahdeo <
>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>
>>>>> Yes, its 8 GB
>>>>>
>>>>> On Tue, Jun 5, 2018 at 2:13 PM, gerald thomas <gerald17006@xxxxxxxxx>
>>>>> wrote:
>>>>>
>>>>>> Kumar,
>>>>>> What is the RAM size of this server, Is it 8BG?
>>>>>>
>>>>>> On Tue, Jun 5, 2018 at 6:39 AM, Kumar Shahdeo <
>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>
>>>>>>> I am using Postgres 9.4 . Please find the attached postgres conf file
>>>>>>>
>>>>>>> On Tue, Jun 5, 2018 at 11:24 AM, gerald thomas <
>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>
>>>>>>>> Dear Kumar,
>>>>>>>> What version of Postgres are running? Normally, these errors occurs
>>>>>>>> when the postgres.conf is not configured properly based on the data size it
>>>>>>>> has to analyzed.
>>>>>>>> Please can you send your Postgres.conf file.
>>>>>>>>
>>>>>>>> On Tue, 5 Jun 2018 at 05:40, Kumar Shahdeo <
>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>
>>>>>>>>> Yes, I rebooted the server, but still I am getting the same issue
>>>>>>>>> while running analytics
>>>>>>>>>
>>>>>>>>> On Tue, Jun 5, 2018 at 10:52 AM, gerald thomas <
>>>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>
>>>>>>>>>> Dear Kumar,
>>>>>>>>>> Have you tried to reboot the server after upgrades and then run
>>>>>>>>>> analytics again?
>>>>>>>>>>
>>>>>>>>>> On Tue, 5 Jun 2018 at 04:49, Kumar Shahdeo <
>>>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi DHIS users,
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> I have migrated from DHIS 2.27 to DHIS 2.29. I used the upgrade
>>>>>>>>>>> script provided by DHIS to upgrade the db. I have tried both incremental
>>>>>>>>>>> upgrade (2.27->2.28->2.29) and skipping 2.28(2.27->2.29). In both the cases
>>>>>>>>>>> I am getting the same issue.
>>>>>>>>>>>
>>>>>>>>>>> I am not able to run analytics. Analytics fails with below
>>>>>>>>>>> error(captured in screenshot)
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> When I checked server logs. I got this exception :
>>>>>>>>>>>
>>>>>>>>>>> org.springframework.dao.DataIntegrityViolationException with
>>>>>>>>>>> error message ‘new row for relation "analytics_temp_2012" violates check
>>>>>>>>>>> constraint "analytics_temp_2012,_yearly_check”’
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> Any suggestions on this will be highly appreciated.
>>>>>>>>>>>
>>>>>>>>>>> Regards
>>>>>>>>>>> --
>>>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>>>> Developer
>>>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>>> _______________________________________________
>>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Regards,
>>>>>>>>>>
>>>>>>>>>> Gerald
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>> Developer
>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>
>>>>>>>> --
>>>>>>>> Regards,
>>>>>>>>
>>>>>>>> Gerald
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>> Developer
>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>> [image: ThoughtWorks]
>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Regards,
>>>>>>
>>>>>> Gerald
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Kumar Gaurav Nath Shahdeo
>>>>> Developer
>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>> [image: ThoughtWorks]
>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Regards,
>>>>
>>>> Gerald
>>>>
>>>
>>>
>>>
>>> --
>>> Regards,
>>>
>>> Gerald
>>>
>>
>>
>>
>> --
>> Kumar Gaurav Nath Shahdeo
>> Developer
>> Email gauravns@xxxxxxxxxxxxxxxx
>> Telephone +91 9160688935 <+91+9160688935>
>> [image: ThoughtWorks]
>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~dhis2-users
>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~dhis2-users
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-users
> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp
>


-- 
Knut Staring

Department of Information, Evidence and Research
World Health Organization, Geneva, Switzerland
Office: +41 22 791 3683 Mob1: +33 6 4434 2931 Mob2: +47 9188 0522
Skype:     knutstar

PNG image


Follow ups

References