← Back to team overview

dhis2-devs team mailing list archive

Re: [Dhis2-users] Data Loss

 

El 24/08/2015, a las 08:00, gerald thomas <gerald17006@xxxxxxxxx> escribió:

> Dear Juan,
> Under Maintenance column i am seeing the following:
> 
> Clear analytics tables
> 
> Clear data mart
> 
> Rebuild data mart index
> 
> Clear zero values
> 
> Clear data set completeness
> 
> Prune periods
> 
> Remove expired invitations
> 
> Drop SQL views
> 
> Create SQL views
> 
> Update category option combinations
> 
> What should I check for the performance maintenance before doing the
> query again?
> 
> On 8/24/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>> Dear Juan,
>> No!!! This is the holistic data from that query. Previously i only had
>> the first part of the result. Do you want me to rebuild tables and run
>> query again?
>> 
>> On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>>> Hello Gerald
>>> This looks much different than the fist one you sent me and it's still
>>> missing a lot of names, did you rebuild resource tables?
>>> JM
>>> 
>>> El 24/08/2015, a las 05:44, gerald thomas <gerald17006@xxxxxxxxx>
>>> escribió:
>>> 
>>>> Dear Juan,
>>>> Thanks for your responses.
>>>> Sorry i am only responding now but please find the attached category
>>>> combo query.
>>>> 
>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>>>>> Sorry, I got distracted and hit send before completing the message.
>>>>> 
>>>>> You should limit the query to show the values of the specific data
>>>>> elements
>>>>> that are giving you trouble, you'll need the uid of each of the data
>>>>> element., In case you don't know how to get that information, you can
>>>>> use
>>>>> the api (your_server_URL/api/dataElements?paging=false) or look at the
>>>>> information if each data element in data element management selecting
>>>>> "show
>>>>> details" from the contextual menu that appears when clocking on the
>>>>> name
>>>>> of
>>>>> each data element. Then add to the query the list of UIDs just before
>>>>> the
>>>>> semicolon.
>>>>> 
>>>>> WHERE de.uid IN
>>>>> ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')
>>>>> 
>>>>> Please excuse me if you already know all of these things, since I don't
>>>>> have
>>>>> a way to know how much you know about the system and postgres queries I
>>>>> rather be detailed on what you have to do than leave you guessing.
>>>>> 
>>>>> In addition to running maintenance to update category option
>>>>> combinations
>>>>> you should re-generate resource tables, you'll find that in "Data
>>>>> Administration" too.
>>>>> 
>>>>> 
>>>>> Regards,
>>>>> JM
>>>>> 
>>>>> 
>>>>> 
>>>>> El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta
>>>>> <jmalcantara1@xxxxxxxxx> escribió:
>>>>> 
>>>>>> Hi Gerald
>>>>>> I see you are missing a few category option combo names, you should
>>>>>> run
>>>>>> the maintenance to "Update category option combinations", you'll find
>>>>>> this
>>>>>> in "Data Administration" -> "maintenance"
>>>>>> I also don't see the option combinations of the data elements you
>>>>>> highlighted in the excel you sent to the list. Which category
>>>>>> combination
>>>>>> are you using with those data elements? Run the query again after
>>>>>> doing
>>>>>> the maintenance.
>>>>>> 
>>>>>> <15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs
>>>>>> 
>>>>>> About the out of memory error, I recommend that you use pgAdmin3 and
>>>>>> try
>>>>>> to run the query again. You should limit the query to show you the
>>>>>> data
>>>>>> 
>>>>>> El 23/08/2015, a las 15:39, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>> escribió:
>>>>>> 
>>>>>>> Dear Juan,
>>>>>>> For the datavalues query; i am getting "Out of memory" as result.
>>>>>>> Please find the attached result for the combo query.
>>>>>>> 
>>>>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>>>> wrote:
>>>>>>>> Hello Gerald
>>>>>>>> Does data disappear only from data elements that use the default
>>>>>>>> category
>>>>>>>> combination?
>>>>>>>> Since you are querying your database directly, I'm sending you here
>>>>>>>> a
>>>>>>>> couple
>>>>>>>> of queries you can use to verify the existing values of the database
>>>>>>>> and
>>>>>>>> the
>>>>>>>> category combinations. Check if you have more than one default
>>>>>>>> option
>>>>>>>> combination.
>>>>>>>> 
>>>>>>>> Regards,
>>>>>>>> JM
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>>> El 23/08/2015, a las 11:36, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>> escribió:
>>>>>>>> 
>>>>>>>>> Juan,
>>>>>>>>> Thanks for your response but we are not using custom forms for data
>>>>>>>>> entry.
>>>>>>>>> 
>>>>>>>>> Regards,
>>>>>>>>> Gerald
>>>>>>>>> 
>>>>>>>>> On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta"
>>>>>>>>> <jmalcantara1@xxxxxxxxx> wrote:
>>>>>>>>> Hello Gerald
>>>>>>>>> Are you using custom forms for data entry?
>>>>>>>>> JM
>>>>>>>>> El 22/08/2015, a las 15:37, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>>> escribió:
>>>>>>>>> 
>>>>>>>>>> Dear dhis2-users,
>>>>>>>>>> If someone cannot help me; can anyone explain why am i having data
>>>>>>>>>> for
>>>>>>>>>> October, November, December 2015 on my database?
>>>>>>>>>> 
>>>>>>>>>> dhis=# select * from period where startdate > '2015-01-01';
>>>>>>>>>> periodid | periodtypeid | startdate  |  enddate
>>>>>>>>>> ----------+--------------+------------+------------
>>>>>>>>>> 1121694 |            6 | 2016-01-01 | 2016-12-31
>>>>>>>>>> 2058605 |            3 | 2015-11-01 | 2015-11-30
>>>>>>>>>> 2058606 |            3 | 2015-12-01 | 2015-12-31
>>>>>>>>>> 2058607 |            3 | 2015-10-01 | 2015-10-31
>>>>>>>>>> 2058611 |            1 | 2015-01-16 | 2015-01-16
>>>>>>>>>> 2058619 |            1 | 2015-01-26 | 2015-01-26
>>>>>>>>>> 2058631 |            1 | 2015-01-29 | 2015-01-29
>>>>>>>>>> 2058632 |            3 | 2015-09-01 | 2015-09-30
>>>>>>>>>> 2058656 |            3 | 2015-02-01 | 2015-02-28
>>>>>>>>>> 2058727 |            3 | 2015-06-01 | 2015-06-30
>>>>>>>>>> 2058806 |            3 | 2015-07-01 | 2015-07-31
>>>>>>>>>> 2058811 |            2 | 2015-03-02 | 2015-03-08
>>>>>>>>>> 2058812 |            3 | 2015-03-01 | 2015-03-31
>>>>>>>>>> 2058814 |            3 | 2015-05-01 | 2015-05-31
>>>>>>>>>> 2065151 |            6 | 2020-01-01 | 2020-12-31
>>>>>>>>>> 2072304 |            3 | 2015-04-01 | 2015-04-30
>>>>>>>>>> 2109802 |            4 | 2015-04-01 | 2015-06-30
>>>>>>>>>> 2115342 |            3 | 2015-08-01 | 2015-08-31
>>>>>>>>>> 2122928 |       292091 | 2015-03-01 | 2015-04-30
>>>>>>>>>> 2129098 |            2 | 2015-05-25 | 2015-05-31
>>>>>>>>>> 2129099 |            1 | 2015-12-31 | 2015-12-31
>>>>>>>>>> Please we need to fix this issue of data loss; can anyone out
>>>>>>>>>> there
>>>>>>>>>> help
>>>>>>>>>> me.
>>>>>>>>>> Please !!!!!!!!!!!!!!!
>>>>>>>>>> 
>>>>>>>>>> On 8/20/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>> Dear All,
>>>>>>>>>>> We are having a serious issues on our online server in Sierra
>>>>>>>>>>> Leone.
>>>>>>>>>>> Data are normally entered but during analysis these data normally
>>>>>>>>>>> got
>>>>>>>>>>> missing. This had been an issue i had raised before but the
>>>>>>>>>>> situation
>>>>>>>>>>> is still the same and it is even worst now.
>>>>>>>>>>> 
>>>>>>>>>>> Please this is an urgent technical problem we need to fix for
>>>>>>>>>>> Sierra
>>>>>>>>>>> Leone and any help will be appreciated till we overcome this
>>>>>>>>>>> situation.
>>>>>>>>>>> 
>>>>>>>>>>> Please help us!!!!!
>>>>>>>>>>> 
>>>>>>>>>>> --
>>>>>>>>>>> Regards,
>>>>>>>>>>> 
>>>>>>>>>>> Gerald
>>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> 
>>>>>>>>>> --
>>>>>>>>>> Regards,
>>>>>>>>>> 
>>>>>>>>>> Gerald
>>>>>>>>>> 
>>>>>>>>>> _______________________________________________
>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>> 
>>>>>>>> 
>>>>>>>> 
>>>>>>> 
>>>>>>> 
>>>>>>> --
>>>>>>> Regards,
>>>>>>> 
>>>>>>> Gerald
>>>>>>> <Combo_Query result.txt>
>>>>>> 
>>>>> 
>>>>> 
>>>> 
>>>> 
>>>> --
>>>> Regards,
>>>> 
>>>> Gerald
>>>> <categoryoptioncombon.txt>
>>> 
>>> 
>> 
>> 
>> --
>> Regards,
>> 
>> Gerald
>> 
> 
> 
> -- 
> Regards,
> 
> Gerald



References