← Back to team overview

dhis2-devs team mailing list archive

Re: [Dhis2-users] Data Loss

 

Dear Juan,
Noted!!! It is now generating resource table and i will keep you
posted once it had been completed

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
> Select "Update category option combinations" and click on  "perform
> maintenance". After that finished select from the menu of the left "Resource
> Table" and click on "Generate tables".
> Regards,
> JM
>
> El 24/08/2015, a las 08:00, gerald thomas <gerald17006@xxxxxxxxx> escribió:
>
>> Dear Juan,
>> Under Maintenance column i am seeing the following:
>>
>> Clear analytics tables
>>
>> Clear data mart
>>
>> Rebuild data mart index
>>
>> Clear zero values
>>
>> Clear data set completeness
>>
>> Prune periods
>>
>> Remove expired invitations
>>
>> Drop SQL views
>>
>> Create SQL views
>>
>> Update category option combinations
>>
>> What should I check for the performance maintenance before doing the
>> query again?
>>
>> On 8/24/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>> Dear Juan,
>>> No!!! This is the holistic data from that query. Previously i only had
>>> the first part of the result. Do you want me to rebuild tables and run
>>> query again?
>>>
>>> On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>>>> Hello Gerald
>>>> This looks much different than the fist one you sent me and it's still
>>>> missing a lot of names, did you rebuild resource tables?
>>>> JM
>>>>
>>>> El 24/08/2015, a las 05:44, gerald thomas <gerald17006@xxxxxxxxx>
>>>> escribió:
>>>>
>>>>> Dear Juan,
>>>>> Thanks for your responses.
>>>>> Sorry i am only responding now but please find the attached category
>>>>> combo query.
>>>>>
>>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>> wrote:
>>>>>> Sorry, I got distracted and hit send before completing the message.
>>>>>>
>>>>>> You should limit the query to show the values of the specific data
>>>>>> elements
>>>>>> that are giving you trouble, you'll need the uid of each of the data
>>>>>> element., In case you don't know how to get that information, you can
>>>>>> use
>>>>>> the api (your_server_URL/api/dataElements?paging=false) or look at
>>>>>> the
>>>>>> information if each data element in data element management selecting
>>>>>> "show
>>>>>> details" from the contextual menu that appears when clocking on the
>>>>>> name
>>>>>> of
>>>>>> each data element. Then add to the query the list of UIDs just before
>>>>>> the
>>>>>> semicolon.
>>>>>>
>>>>>> WHERE de.uid IN
>>>>>> ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')
>>>>>>
>>>>>> Please excuse me if you already know all of these things, since I
>>>>>> don't
>>>>>> have
>>>>>> a way to know how much you know about the system and postgres queries
>>>>>> I
>>>>>> rather be detailed on what you have to do than leave you guessing.
>>>>>>
>>>>>> In addition to running maintenance to update category option
>>>>>> combinations
>>>>>> you should re-generate resource tables, you'll find that in "Data
>>>>>> Administration" too.
>>>>>>
>>>>>>
>>>>>> Regards,
>>>>>> JM
>>>>>>
>>>>>>
>>>>>>
>>>>>> El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta
>>>>>> <jmalcantara1@xxxxxxxxx> escribió:
>>>>>>
>>>>>>> Hi Gerald
>>>>>>> I see you are missing a few category option combo names, you should
>>>>>>> run
>>>>>>> the maintenance to "Update category option combinations", you'll
>>>>>>> find
>>>>>>> this
>>>>>>> in "Data Administration" -> "maintenance"
>>>>>>> I also don't see the option combinations of the data elements you
>>>>>>> highlighted in the excel you sent to the list. Which category
>>>>>>> combination
>>>>>>> are you using with those data elements? Run the query again after
>>>>>>> doing
>>>>>>> the maintenance.
>>>>>>>
>>>>>>> <15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs
>>>>>>>
>>>>>>> About the out of memory error, I recommend that you use pgAdmin3 and
>>>>>>> try
>>>>>>> to run the query again. You should limit the query to show you the
>>>>>>> data
>>>>>>>
>>>>>>> El 23/08/2015, a las 15:39, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>> escribió:
>>>>>>>
>>>>>>>> Dear Juan,
>>>>>>>> For the datavalues query; i am getting "Out of memory" as result.
>>>>>>>> Please find the attached result for the combo query.
>>>>>>>>
>>>>>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>>>>> wrote:
>>>>>>>>> Hello Gerald
>>>>>>>>> Does data disappear only from data elements that use the default
>>>>>>>>> category
>>>>>>>>> combination?
>>>>>>>>> Since you are querying your database directly, I'm sending you
>>>>>>>>> here
>>>>>>>>> a
>>>>>>>>> couple
>>>>>>>>> of queries you can use to verify the existing values of the
>>>>>>>>> database
>>>>>>>>> and
>>>>>>>>> the
>>>>>>>>> category combinations. Check if you have more than one default
>>>>>>>>> option
>>>>>>>>> combination.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> JM
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> El 23/08/2015, a las 11:36, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>>> escribió:
>>>>>>>>>
>>>>>>>>>> Juan,
>>>>>>>>>> Thanks for your response but we are not using custom forms for
>>>>>>>>>> data
>>>>>>>>>> entry.
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>> Gerald
>>>>>>>>>>
>>>>>>>>>> On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta"
>>>>>>>>>> <jmalcantara1@xxxxxxxxx> wrote:
>>>>>>>>>> Hello Gerald
>>>>>>>>>> Are you using custom forms for data entry?
>>>>>>>>>> JM
>>>>>>>>>> El 22/08/2015, a las 15:37, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>>>> escribió:
>>>>>>>>>>
>>>>>>>>>>> Dear dhis2-users,
>>>>>>>>>>> If someone cannot help me; can anyone explain why am i having
>>>>>>>>>>> data
>>>>>>>>>>> for
>>>>>>>>>>> October, November, December 2015 on my database?
>>>>>>>>>>>
>>>>>>>>>>> dhis=# select * from period where startdate > '2015-01-01';
>>>>>>>>>>> periodid | periodtypeid | startdate  |  enddate
>>>>>>>>>>> ----------+--------------+------------+------------
>>>>>>>>>>> 1121694 |            6 | 2016-01-01 | 2016-12-31
>>>>>>>>>>> 2058605 |            3 | 2015-11-01 | 2015-11-30
>>>>>>>>>>> 2058606 |            3 | 2015-12-01 | 2015-12-31
>>>>>>>>>>> 2058607 |            3 | 2015-10-01 | 2015-10-31
>>>>>>>>>>> 2058611 |            1 | 2015-01-16 | 2015-01-16
>>>>>>>>>>> 2058619 |            1 | 2015-01-26 | 2015-01-26
>>>>>>>>>>> 2058631 |            1 | 2015-01-29 | 2015-01-29
>>>>>>>>>>> 2058632 |            3 | 2015-09-01 | 2015-09-30
>>>>>>>>>>> 2058656 |            3 | 2015-02-01 | 2015-02-28
>>>>>>>>>>> 2058727 |            3 | 2015-06-01 | 2015-06-30
>>>>>>>>>>> 2058806 |            3 | 2015-07-01 | 2015-07-31
>>>>>>>>>>> 2058811 |            2 | 2015-03-02 | 2015-03-08
>>>>>>>>>>> 2058812 |            3 | 2015-03-01 | 2015-03-31
>>>>>>>>>>> 2058814 |            3 | 2015-05-01 | 2015-05-31
>>>>>>>>>>> 2065151 |            6 | 2020-01-01 | 2020-12-31
>>>>>>>>>>> 2072304 |            3 | 2015-04-01 | 2015-04-30
>>>>>>>>>>> 2109802 |            4 | 2015-04-01 | 2015-06-30
>>>>>>>>>>> 2115342 |            3 | 2015-08-01 | 2015-08-31
>>>>>>>>>>> 2122928 |       292091 | 2015-03-01 | 2015-04-30
>>>>>>>>>>> 2129098 |            2 | 2015-05-25 | 2015-05-31
>>>>>>>>>>> 2129099 |            1 | 2015-12-31 | 2015-12-31
>>>>>>>>>>> Please we need to fix this issue of data loss; can anyone out
>>>>>>>>>>> there
>>>>>>>>>>> help
>>>>>>>>>>> me.
>>>>>>>>>>> Please !!!!!!!!!!!!!!!
>>>>>>>>>>>
>>>>>>>>>>> On 8/20/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>>> Dear All,
>>>>>>>>>>>> We are having a serious issues on our online server in Sierra
>>>>>>>>>>>> Leone.
>>>>>>>>>>>> Data are normally entered but during analysis these data
>>>>>>>>>>>> normally
>>>>>>>>>>>> got
>>>>>>>>>>>> missing. This had been an issue i had raised before but the
>>>>>>>>>>>> situation
>>>>>>>>>>>> is still the same and it is even worst now.
>>>>>>>>>>>>
>>>>>>>>>>>> Please this is an urgent technical problem we need to fix for
>>>>>>>>>>>> Sierra
>>>>>>>>>>>> Leone and any help will be appreciated till we overcome this
>>>>>>>>>>>> situation.
>>>>>>>>>>>>
>>>>>>>>>>>> Please help us!!!!!
>>>>>>>>>>>>
>>>>>>>>>>>> --
>>>>>>>>>>>> Regards,
>>>>>>>>>>>>
>>>>>>>>>>>> Gerald
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Regards,
>>>>>>>>>>>
>>>>>>>>>>> Gerald
>>>>>>>>>>>
>>>>>>>>>>> _______________________________________________
>>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Regards,
>>>>>>>>
>>>>>>>> Gerald
>>>>>>>> <Combo_Query result.txt>
>>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Regards,
>>>>>
>>>>> Gerald
>>>>> <categoryoptioncombon.txt>
>>>>
>>>>
>>>
>>>
>>> --
>>> Regards,
>>>
>>> Gerald
>>>
>>
>>
>> --
>> Regards,
>>
>> Gerald
>
>


-- 
Regards,

Gerald


Follow ups

References