← Back to team overview

dhis2-users team mailing list archive

Re: [Dhis2-devs] Error while running analytics in 2.29

 

Yes, this was fixed two days back. I saw some new commits were made in
2.29. I have taken the latest commit and now I see that the issue is
resolved.
Thanks for inputs !!

Regards
Gaurav

On Tue, Jun 5, 2018 at 10:46 PM, David Huser <dhuser@xxxxxxxxxxxxxx> wrote:

> Hi, this might be a bug that got fixed recently - see here:
> https://jira.dhis2.org/browse/DHIS2-3844
>
> Best,
> David
>
> On Tue, Jun 5, 2018 at 2:34 PM, Kumar Shahdeo <gauravns@xxxxxxxxxxxxxxxx>
> wrote:
>
>> Thanks for input Bob and Knut. I have logged a jira ticket for this issue.
>> Ticket can be viewed here https://jira.dhis2.org/browse/DHIS2-3922
>>
>> Regards
>> Gaurav
>>
>> On Tue, Jun 5, 2018 at 5:30 PM, Knut Staring <knutst@xxxxxxxxx> wrote:
>>
>>> I encountered exactly the same bug, but shamefully did not report, just
>>> coped with it by removing data older than 2014 as I did not need it.
>>>
>>> Knut
>>>
>>> On Tue, Jun 5, 2018 at 1:58 PM Bob Jolliffe <bobjolliffe@xxxxxxxxx>
>>> wrote:
>>>
>>>> Hi Kumar
>>>>
>>>> That does indeed look like a bug.  In which case you should create a
>>>> jira issue.
>>>>
>>>> I am just a little surprised that there is nobody else with weekly data
>>>> from 2012/2013 reporting the same problem.  That would be good to confirm.
>>>>
>>>> Bob
>>>>
>>>> On 5 June 2018 at 11:34, Kumar Shahdeo <gauravns@xxxxxxxxxxxxxxxx>
>>>> wrote:
>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> *Thanks for the inputs Gerald. I have made the changes in postgres
>>>>> conf file. However, I was still facing the same issues.I was looking into
>>>>> the server logs and I have following analysis : - When we run analytics,
>>>>> ANALYTICS_TABLE is created which is clear from this log message [Level:
>>>>> INFO, category: ANALYTICS_TABLE, time: Tue Jun 05 09:51:34 UTC 2018,
>>>>> message: Creating analytics tables]- Once this table is created, we get log
>>>>> message as : Creating partition table: analytics_temp_2012- This table has
>>>>> a constraint on column ‘yearly’ :  “analytics_temp_2012_yearly_check" CHECK
>>>>> (yearly = '2012'::text)- Values are inserted into these table by extracting
>>>>> rows using a sql query. This sql query does an inner join with
>>>>> ‘_periodstructure’ table- One of the rows that was getting inserted into
>>>>> table ‘analytics_temp_2012’ contains following values (this list does not
>>>>> include all the
>>>>> columns)biweekly2013BiW0monthly201301bimonthly201301Bquarterly2013Q1sixmonthly2013S1sixmonthlyapril2012AprilS2yearly2013financialapril2012Aprilfinancialjuly2012Julyfinancialoct2012Octstartdate2012-12-31enddate2013-01-06year2012
>>>>> - Here we can see that if the week starts on 2012(‘startdate’ column has
>>>>> value 31-12-2012(dd-mm-yyyy)) and ends on 2013(‘enddate’ is 06-01-2012),
>>>>> and majority of days for that week falls in 2013. Then the value for column
>>>>> ‘yearly’ is populated as ‘2013’, while the constraint applied on column
>>>>> expects it to be ‘2012’.This seems to be bug on DHIS. Can you please
>>>>> confirm this.*
>>>>> Regards
>>>>> Gaurav
>>>>>
>>>>> On Tue, Jun 5, 2018 at 3:57 PM, gerald thomas <gerald17006@xxxxxxxxx>
>>>>> wrote:
>>>>>
>>>>>> Kumar,
>>>>>> Any update?
>>>>>>
>>>>>> On Tue, Jun 5, 2018 at 9:14 AM, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>> wrote:
>>>>>>
>>>>>>> Kumar,
>>>>>>> Kindly change the following on your postgresql.conf:
>>>>>>> shared_buffers = 2120 MB
>>>>>>> effective_cache_size = 5300 MB
>>>>>>>
>>>>>>> Then do:
>>>>>>> sudo service postgres restart
>>>>>>>
>>>>>>> And run analytics again
>>>>>>>
>>>>>>> On Tue, Jun 5, 2018 at 8:58 AM, Kumar Shahdeo <
>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>
>>>>>>>> Yes, its 8 GB
>>>>>>>>
>>>>>>>> On Tue, Jun 5, 2018 at 2:13 PM, gerald thomas <
>>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>>
>>>>>>>>> Kumar,
>>>>>>>>> What is the RAM size of this server, Is it 8BG?
>>>>>>>>>
>>>>>>>>> On Tue, Jun 5, 2018 at 6:39 AM, Kumar Shahdeo <
>>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>
>>>>>>>>>> I am using Postgres 9.4 . Please find the attached postgres conf
>>>>>>>>>> file
>>>>>>>>>>
>>>>>>>>>> On Tue, Jun 5, 2018 at 11:24 AM, gerald thomas <
>>>>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>
>>>>>>>>>>> Dear Kumar,
>>>>>>>>>>> What version of Postgres are running? Normally, these errors
>>>>>>>>>>> occurs when the postgres.conf is not configured properly based on the data
>>>>>>>>>>> size it has to analyzed.
>>>>>>>>>>> Please can you send your Postgres.conf file.
>>>>>>>>>>>
>>>>>>>>>>> On Tue, 5 Jun 2018 at 05:40, Kumar Shahdeo <
>>>>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Yes, I rebooted the server, but still I am getting the same
>>>>>>>>>>>> issue while running analytics
>>>>>>>>>>>>
>>>>>>>>>>>> On Tue, Jun 5, 2018 at 10:52 AM, gerald thomas <
>>>>>>>>>>>> gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> Dear Kumar,
>>>>>>>>>>>>> Have you tried to reboot the server after upgrades and then
>>>>>>>>>>>>> run analytics again?
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Tue, 5 Jun 2018 at 04:49, Kumar Shahdeo <
>>>>>>>>>>>>> gauravns@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Hi DHIS users,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I have migrated from DHIS 2.27 to DHIS 2.29. I used the
>>>>>>>>>>>>>> upgrade script provided by DHIS to upgrade the db. I have tried both
>>>>>>>>>>>>>> incremental upgrade (2.27->2.28->2.29) and skipping 2.28(2.27->2.29). In
>>>>>>>>>>>>>> both the cases I am getting the same issue.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> I am not able to run analytics. Analytics fails with below
>>>>>>>>>>>>>> error(captured in screenshot)
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> When I checked server logs. I got this exception :
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> org.springframework.dao.DataIntegrityViolationException with
>>>>>>>>>>>>>> error message ‘new row for relation "analytics_temp_2012" violates check
>>>>>>>>>>>>>> constraint "analytics_temp_2012,_yearly_check”’
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Any suggestions on this will be highly appreciated.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Regards
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>>>>>>> Developer
>>>>>>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Gerald
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>>>>> Developer
>>>>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Regards,
>>>>>>>>>>>
>>>>>>>>>>> Gerald
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>>>> Developer
>>>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>>>> [image: ThoughtWorks]
>>>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Regards,
>>>>>>>>>
>>>>>>>>> Gerald
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Kumar Gaurav Nath Shahdeo
>>>>>>>> Developer
>>>>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>>>>> [image: ThoughtWorks]
>>>>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Regards,
>>>>>>>
>>>>>>> Gerald
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Regards,
>>>>>>
>>>>>> Gerald
>>>>>>
>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Kumar Gaurav Nath Shahdeo
>>>>> Developer
>>>>> Email gauravns@xxxxxxxxxxxxxxxx
>>>>> Telephone +91 9160688935 <+91+9160688935>
>>>>> [image: ThoughtWorks]
>>>>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>>>
>>>>> _______________________________________________
>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>
>>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>> More help   : https://help.launchpad.net/ListHelp
>>>>
>>>
>>>
>>> --
>>> Knut Staring
>>>
>>> Department of Information, Evidence and Research
>>> World Health Organization, Geneva, Switzerland
>>> Office: +41 22 791 3683 Mob1: +33 6 4434 2931 Mob2: +47 9188 0522
>>> Skype:     knutstar
>>>
>>
>>
>>
>> --
>> Kumar Gaurav Nath Shahdeo
>> Developer
>> Email gauravns@xxxxxxxxxxxxxxxx
>> Telephone +91 9160688935 <+91+9160688935>
>> [image: ThoughtWorks]
>> <http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~dhis2-devs
>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~dhis2-devs
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
>
>
> *David Huser*
> DHIS2 Support Specialist
> dhuser@xxxxxxxxxxxxxx | https://baosystems.com |  2900 K Street, Suite
> 507, Washington D.C. 20007
>



-- 
Kumar Gaurav Nath Shahdeo
Developer
Email gauravns@xxxxxxxxxxxxxxxx
Telephone +91 9160688935 <+91+9160688935>
[image: ThoughtWorks]
<http://www.thoughtworks.com/?utm_campaign=kumar-gaurav%20nath%20shahdeo-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>

PNG image


References