← Back to team overview

dhis2-devs team mailing list archive

Re: [Dhis2-users] Data Loss

 

Dear Juan,
Under Maintenance column i am seeing the following:

Clear analytics tables

Clear data mart

Rebuild data mart index

Clear zero values

Clear data set completeness

Prune periods

Remove expired invitations

Drop SQL views

Create SQL views

Update category option combinations

What should I check for the performance maintenance before doing the
query again?

On 8/24/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
> Dear Juan,
> No!!! This is the holistic data from that query. Previously i only had
> the first part of the result. Do you want me to rebuild tables and run
> query again?
>
> On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>> Hello Gerald
>> This looks much different than the fist one you sent me and it's still
>> missing a lot of names, did you rebuild resource tables?
>> JM
>>
>> El 24/08/2015, a las 05:44, gerald thomas <gerald17006@xxxxxxxxx>
>> escribió:
>>
>>> Dear Juan,
>>> Thanks for your responses.
>>> Sorry i am only responding now but please find the attached category
>>> combo query.
>>>
>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>>>> Sorry, I got distracted and hit send before completing the message.
>>>>
>>>> You should limit the query to show the values of the specific data
>>>> elements
>>>> that are giving you trouble, you'll need the uid of each of the data
>>>> element., In case you don't know how to get that information, you can
>>>> use
>>>> the api (your_server_URL/api/dataElements?paging=false) or look at the
>>>> information if each data element in data element management selecting
>>>> "show
>>>> details" from the contextual menu that appears when clocking on the
>>>> name
>>>> of
>>>> each data element. Then add to the query the list of UIDs just before
>>>> the
>>>> semicolon.
>>>>
>>>> WHERE de.uid IN
>>>> ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')
>>>>
>>>> Please excuse me if you already know all of these things, since I don't
>>>> have
>>>> a way to know how much you know about the system and postgres queries I
>>>> rather be detailed on what you have to do than leave you guessing.
>>>>
>>>> In addition to running maintenance to update category option
>>>> combinations
>>>> you should re-generate resource tables, you'll find that in "Data
>>>> Administration" too.
>>>>
>>>>
>>>> Regards,
>>>> JM
>>>>
>>>>
>>>>
>>>> El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta
>>>> <jmalcantara1@xxxxxxxxx> escribió:
>>>>
>>>>> Hi Gerald
>>>>> I see you are missing a few category option combo names, you should
>>>>> run
>>>>> the maintenance to "Update category option combinations", you'll find
>>>>> this
>>>>> in "Data Administration" -> "maintenance"
>>>>> I also don't see the option combinations of the data elements you
>>>>> highlighted in the excel you sent to the list. Which category
>>>>> combination
>>>>> are you using with those data elements? Run the query again after
>>>>> doing
>>>>> the maintenance.
>>>>>
>>>>> <15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs
>>>>>
>>>>> About the out of memory error, I recommend that you use pgAdmin3 and
>>>>> try
>>>>> to run the query again. You should limit the query to show you the
>>>>> data
>>>>>
>>>>> El 23/08/2015, a las 15:39, gerald thomas <gerald17006@xxxxxxxxx>
>>>>> escribió:
>>>>>
>>>>>> Dear Juan,
>>>>>> For the datavalues query; i am getting "Out of memory" as result.
>>>>>> Please find the attached result for the combo query.
>>>>>>
>>>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>>> wrote:
>>>>>>> Hello Gerald
>>>>>>> Does data disappear only from data elements that use the default
>>>>>>> category
>>>>>>> combination?
>>>>>>> Since you are querying your database directly, I'm sending you here
>>>>>>> a
>>>>>>> couple
>>>>>>> of queries you can use to verify the existing values of the database
>>>>>>> and
>>>>>>> the
>>>>>>> category combinations. Check if you have more than one default
>>>>>>> option
>>>>>>> combination.
>>>>>>>
>>>>>>> Regards,
>>>>>>> JM
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> El 23/08/2015, a las 11:36, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>> escribió:
>>>>>>>
>>>>>>>> Juan,
>>>>>>>> Thanks for your response but we are not using custom forms for data
>>>>>>>> entry.
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> Gerald
>>>>>>>>
>>>>>>>> On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta"
>>>>>>>> <jmalcantara1@xxxxxxxxx> wrote:
>>>>>>>> Hello Gerald
>>>>>>>> Are you using custom forms for data entry?
>>>>>>>> JM
>>>>>>>> El 22/08/2015, a las 15:37, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>> escribió:
>>>>>>>>
>>>>>>>>> Dear dhis2-users,
>>>>>>>>> If someone cannot help me; can anyone explain why am i having data
>>>>>>>>> for
>>>>>>>>> October, November, December 2015 on my database?
>>>>>>>>>
>>>>>>>>> dhis=# select * from period where startdate > '2015-01-01';
>>>>>>>>> periodid | periodtypeid | startdate  |  enddate
>>>>>>>>> ----------+--------------+------------+------------
>>>>>>>>> 1121694 |            6 | 2016-01-01 | 2016-12-31
>>>>>>>>> 2058605 |            3 | 2015-11-01 | 2015-11-30
>>>>>>>>> 2058606 |            3 | 2015-12-01 | 2015-12-31
>>>>>>>>> 2058607 |            3 | 2015-10-01 | 2015-10-31
>>>>>>>>> 2058611 |            1 | 2015-01-16 | 2015-01-16
>>>>>>>>> 2058619 |            1 | 2015-01-26 | 2015-01-26
>>>>>>>>> 2058631 |            1 | 2015-01-29 | 2015-01-29
>>>>>>>>> 2058632 |            3 | 2015-09-01 | 2015-09-30
>>>>>>>>> 2058656 |            3 | 2015-02-01 | 2015-02-28
>>>>>>>>> 2058727 |            3 | 2015-06-01 | 2015-06-30
>>>>>>>>> 2058806 |            3 | 2015-07-01 | 2015-07-31
>>>>>>>>> 2058811 |            2 | 2015-03-02 | 2015-03-08
>>>>>>>>> 2058812 |            3 | 2015-03-01 | 2015-03-31
>>>>>>>>> 2058814 |            3 | 2015-05-01 | 2015-05-31
>>>>>>>>> 2065151 |            6 | 2020-01-01 | 2020-12-31
>>>>>>>>> 2072304 |            3 | 2015-04-01 | 2015-04-30
>>>>>>>>> 2109802 |            4 | 2015-04-01 | 2015-06-30
>>>>>>>>> 2115342 |            3 | 2015-08-01 | 2015-08-31
>>>>>>>>> 2122928 |       292091 | 2015-03-01 | 2015-04-30
>>>>>>>>> 2129098 |            2 | 2015-05-25 | 2015-05-31
>>>>>>>>> 2129099 |            1 | 2015-12-31 | 2015-12-31
>>>>>>>>> Please we need to fix this issue of data loss; can anyone out
>>>>>>>>> there
>>>>>>>>> help
>>>>>>>>> me.
>>>>>>>>> Please !!!!!!!!!!!!!!!
>>>>>>>>>
>>>>>>>>> On 8/20/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>> Dear All,
>>>>>>>>>> We are having a serious issues on our online server in Sierra
>>>>>>>>>> Leone.
>>>>>>>>>> Data are normally entered but during analysis these data normally
>>>>>>>>>> got
>>>>>>>>>> missing. This had been an issue i had raised before but the
>>>>>>>>>> situation
>>>>>>>>>> is still the same and it is even worst now.
>>>>>>>>>>
>>>>>>>>>> Please this is an urgent technical problem we need to fix for
>>>>>>>>>> Sierra
>>>>>>>>>> Leone and any help will be appreciated till we overcome this
>>>>>>>>>> situation.
>>>>>>>>>>
>>>>>>>>>> Please help us!!!!!
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Regards,
>>>>>>>>>>
>>>>>>>>>> Gerald
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Regards,
>>>>>>>>>
>>>>>>>>> Gerald
>>>>>>>>>
>>>>>>>>> _______________________________________________
>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Regards,
>>>>>>
>>>>>> Gerald
>>>>>> <Combo_Query result.txt>
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> Regards,
>>>
>>> Gerald
>>> <categoryoptioncombon.txt>
>>
>>
>
>
> --
> Regards,
>
> Gerald
>


-- 
Regards,

Gerald


Follow ups

References