← Back to team overview

dhis2-users team mailing list archive

Re: [Dhis2-devs] Error while running analytics in 2.29

 

Hi, this might be a bug that got fixed recently - see here:
https://jira.dhis2.org/browse/DHIS2-3844

Best,
David

On Tue, Jun 5, 2018 at 2:34 PM, Kumar Shahdeo <gauravns@xxxxxxxxxxxxxxxx>
wrote:

> Thanks for input Bob and Knut. I have logged a jira ticket for this issue.
> Ticket can be viewed here https://jira.dhis2.org/browse/DHIS2-3922
>
> Regards
> Gaurav
>
> On Tue, Jun 5, 2018 at 5:30 PM, Knut Staring <knutst@xxxxxxxxx> wrote:
>
>> I encountered exactly the same bug, but shamefully did not report, just
>> coped with it by removing data older than 2014 as I did not need it.
>>
>> Knut
>>
>> On Tue, Jun 5, 2018 at 1:58 PM Bob Jolliffe <bobjolliffe@xxxxxxxxx>
>> wrote:
>>
>>> Hi Kumar
>>>
>>> That does indeed look like a bug.  In which case you should create a
>>> jira issue.
>>>
>>> I am just a little surprised that there is nobody else with weekly data
>>> from 2012/2013 reporting the same problem.  That would be good to confirm.
>>>
>>> Bob
>>>
>>> On 5 June 2018 at 11:34, Kumar Shahdeo <gauravns@xxxxxxxxxxxxxxxx>
>>> wrote:
>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>>
>>>> *Thanks for the inputs Gerald. I have made the changes in postgres conf
>>>> file. However, I was still facing the same issues.I was looking into the
>>>> server logs and I have following analysis : - When we run analytics,
>>>> ANALYTICS_TABLE is created which is clear from this log message [Level:
>>>> INFO, category: ANALYTICS_TABLE, time: Tue Jun 05 09:51:34 UTC 2018,
>>>> message: Creating analytics tables]- Once this table is created, we get log
>>>> message as : Creating partition table: analytics_temp_2012- This table has
>>>> a constraint on column ‘yearly’ :  “analytics_temp_2012_yearly_check" CHECK
>>>> (yearly = '2012'::text)- Values are inserted into these table by extracting
>>>> rows using a sql query. This sql query does an inner join with
>>>> ‘_periodstructure’ table- One of the rows that was getting inserted into
>>>> table ‘analytics_temp_2012’ contains following values (this list does not
>>>> include all the
>>>> columns)biweekly2013BiW0monthly201301bimonthly201301Bquarterly2013Q1sixmonthly2013S1sixmonthlyapril2012AprilS2yearly2013financialapril2012Aprilfinancialjuly2012Julyfinancialoct2012Octstartdate2012-12-31enddate2013-01-06year2012
>>>> - Here we can see that if the week starts on 2012(‘startdate’ column has
>>>> value 31-12-2012(dd-mm-yyyy)) and ends on 2013(‘enddate’ is 06-01-2012),
>>>> and majority of days for that week falls in 2013. Then the value for column
>>>> ‘yearly’ is populated as ‘2013’, while the constraint applied on column
>>>> expects it to be ‘2012’.This seems to be bug on DHIS. Can you please
>>>> confirm this.*
>>>> Regards
>>>> Gaurav
>>>>
>>>> On Tue, Jun 5, 2018 at 3:57 PM, gerald thomas <gerald17006@xxxxxxxxx>
>>>> wrote:
>>>>
>>>>> Kumar,
>>>>> Any update?
>>>>>
>>>>> On Tue, Jun 5, 2018 at 9:14 AM, gerald thomas <gerald17006@xxxxxxxxx>
>>>>> wrote:
>>>>>
>>>>>> Kumar,
>>>>>> Kindly change the following on your postgresql.conf:
>>>>>> shared_buffers = 2120 MB
>>>>>> effective_cache_size = 5300 MB
>>>>>>
>>>>>> Then do:
>>>>>> sudo service postgres restart
>>>>>>
>>>>>> And run analytics again
>>>>>>
>>>>>> On Tue, Jun 5, 2018 at 8:58 AM, Kumar Shahdeo <
>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>
>>>>>>> Yes, its 8 GB
>>>>>>>
>>>>>>> On Tue, Jun 5, 2018 at 2:13 PM, gerald thomas <gerald17006@xxxxxxxxx
>>>>>>> > wrote:
>>>>>>>
>>>>>>>> Kumar,
>>>>>>>> What is the RAM size of this server, Is it 8BG?
>>>>>>>>
>>>>>>>> On Tue, Jun 5, 2018 at 6:39 AM, Kumar Shahdeo <
>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>
>>>>>>>>> I am using Postgres 9.4 . Please find the attached postgres conf
>>>>>>>>> file
>>>>>>>>>
>>>>>>>>> On Tue, Jun 5, 2018 at 11:24 AM, gerald thomas <
>>>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>
>>>>>>>>>> Dear Kumar,
>>>>>>>>>> What version of Postgres are running? Normally, these errors
>>>>>>>>>> occurs when the postgres.conf is not configured properly based on the data
>>>>>>>>>> size it has to analyzed.
>>>>>>>>>> Please can you send your Postgres.conf file.
>>>>>>>>>>
>>>>>>>>>> On Tue, 5 Jun 2018 at 05:40, Kumar Shahdeo <
>>>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>>
>>>>>>>>>>> Yes, I rebooted the server, but still I am getting the same
>>>>>>>>>>> issue while running analytics
>>>>>>>>>>>
>>>>>>>>>>> On Tue, Jun 5, 2018 at 10:52 AM, gerald thomas <
>>>>>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Dear Kumar,
>>>>>>>>>>>> Have you tried to reboot the server after upgrades and then run
>>>>>>>>>>>> analytics again?
>>>>>>>>>>>>
>>>>>>>>>>>> On Tue, 5 Jun 2018 at 04:49, Kumar Shahdeo <
>>>>>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Hi DHIS users,
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> I have migrated from DHIS 2.27 to DHIS 2.29. I used the
>>>>>>>>>>>>> upgrade script provided by DHIS to upgrade the db. I have tried both
>>>>>>>>>>>>> incremental upgrade (2.27->2.28->2.29) and skipping 2.28(2.27->2.29). In
>>>>>>>>>>>>> both the cases I am getting the same issue.
>>>>>>>>>>>>>
>>>>>>>>>>>>> I am not able to run analytics. Analytics fails with below
>>>>>>>>>>>>> error(captured in screenshot)
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> When I checked server logs. I got this exception :
>>>>>>>>>>>>>
>>>>>>>>>>>>> org.springframework.dao.DataIntegrityViolationException with
>>>>>>>>>>>>> error message ‘new row for relation "analytics_temp_2012" violates check
>>>>>>>>>>>>> constraint "analytics_temp_2012,_yearly_check”’
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> Any suggestions on this will be highly appreciated.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Regards
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>>>>>> Developer
>>>>>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Regards,
>>>>>>>>>>>>
>>>>>>>>>>>> Gerald
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>>>> Developer
>>>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Regards,
>>>>>>>>>>
>>>>>>>>>> Gerald
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>> Developer
>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Regards,
>>>>>>>>
>>>>>>>> Gerald
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>> Developer
>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>> [image: ThoughtWorks]
>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Regards,
>>>>>>
>>>>>> Gerald
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Regards,
>>>>>
>>>>> Gerald
>>>>>
>>>>
>>>>
>>>>
>>>> --
>>>> Kumar Gaurav Nath Shahdeo
>>>> Developer
>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>> Telephone +91 9160688935 <+91+9160688935>
>>>> [image: ThoughtWorks]
>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>> More help   : https://help.launchpad.net/ListHelp
>>>>
>>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-users
>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>
>>
>> --
>> Knut Staring
>>
>> Department of Information, Evidence and Research
>> World Health Organization, Geneva, Switzerland
>> Office: +41 22 791 3683 Mob1: +33 6 4434 2931 Mob2: +47 9188 0522
>> Skype:     knutstar
>>
>
>
>
> --
> Kumar Gaurav Nath Shahdeo
> Developer
> Email gauravns@xxxxxxxxxxxxxxxx
> Telephone +91 9160688935 <+91+9160688935>
> [image: ThoughtWorks]
> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp
>
>


-- 


*David Huser*
DHIS2 Support Specialist
dhuser@xxxxxxxxxxxxxx | https://baosystems.com |  2900 K Street, Suite 507,
Washington D.C. 20007

PNG image


Follow ups

References