dhis2-devs team mailing list archive
-
dhis2-devs team
-
Mailing list archive
-
Message #39084
Re: [Dhis2-users] Data Loss
El 24/08/2015, a las 08:00, gerald thomas <gerald17006@xxxxxxxxx> escribió:
> Dear Juan,
> Under Maintenance column i am seeing the following:
>
> Clear analytics tables
>
> Clear data mart
>
> Rebuild data mart index
>
> Clear zero values
>
> Clear data set completeness
>
> Prune periods
>
> Remove expired invitations
>
> Drop SQL views
>
> Create SQL views
>
> Update category option combinations
>
> What should I check for the performance maintenance before doing the
> query again?
>
> On 8/24/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>> Dear Juan,
>> No!!! This is the holistic data from that query. Previously i only had
>> the first part of the result. Do you want me to rebuild tables and run
>> query again?
>>
>> On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>>> Hello Gerald
>>> This looks much different than the fist one you sent me and it's still
>>> missing a lot of names, did you rebuild resource tables?
>>> JM
>>>
>>> El 24/08/2015, a las 05:44, gerald thomas <gerald17006@xxxxxxxxx>
>>> escribió:
>>>
>>>> Dear Juan,
>>>> Thanks for your responses.
>>>> Sorry i am only responding now but please find the attached category
>>>> combo query.
>>>>
>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>>>>> Sorry, I got distracted and hit send before completing the message.
>>>>>
>>>>> You should limit the query to show the values of the specific data
>>>>> elements
>>>>> that are giving you trouble, you'll need the uid of each of the data
>>>>> element., In case you don't know how to get that information, you can
>>>>> use
>>>>> the api (your_server_URL/api/dataElements?paging=false) or look at the
>>>>> information if each data element in data element management selecting
>>>>> "show
>>>>> details" from the contextual menu that appears when clocking on the
>>>>> name
>>>>> of
>>>>> each data element. Then add to the query the list of UIDs just before
>>>>> the
>>>>> semicolon.
>>>>>
>>>>> WHERE de.uid IN
>>>>> ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')
>>>>>
>>>>> Please excuse me if you already know all of these things, since I don't
>>>>> have
>>>>> a way to know how much you know about the system and postgres queries I
>>>>> rather be detailed on what you have to do than leave you guessing.
>>>>>
>>>>> In addition to running maintenance to update category option
>>>>> combinations
>>>>> you should re-generate resource tables, you'll find that in "Data
>>>>> Administration" too.
>>>>>
>>>>>
>>>>> Regards,
>>>>> JM
>>>>>
>>>>>
>>>>>
>>>>> El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta
>>>>> <jmalcantara1@xxxxxxxxx> escribió:
>>>>>
>>>>>> Hi Gerald
>>>>>> I see you are missing a few category option combo names, you should
>>>>>> run
>>>>>> the maintenance to "Update category option combinations", you'll find
>>>>>> this
>>>>>> in "Data Administration" -> "maintenance"
>>>>>> I also don't see the option combinations of the data elements you
>>>>>> highlighted in the excel you sent to the list. Which category
>>>>>> combination
>>>>>> are you using with those data elements? Run the query again after
>>>>>> doing
>>>>>> the maintenance.
>>>>>>
>>>>>> <15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs
>>>>>>
>>>>>> About the out of memory error, I recommend that you use pgAdmin3 and
>>>>>> try
>>>>>> to run the query again. You should limit the query to show you the
>>>>>> data
>>>>>>
>>>>>> El 23/08/2015, a las 15:39, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>> escribió:
>>>>>>
>>>>>>> Dear Juan,
>>>>>>> For the datavalues query; i am getting "Out of memory" as result.
>>>>>>> Please find the attached result for the combo query.
>>>>>>>
>>>>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>>>> wrote:
>>>>>>>> Hello Gerald
>>>>>>>> Does data disappear only from data elements that use the default
>>>>>>>> category
>>>>>>>> combination?
>>>>>>>> Since you are querying your database directly, I'm sending you here
>>>>>>>> a
>>>>>>>> couple
>>>>>>>> of queries you can use to verify the existing values of the database
>>>>>>>> and
>>>>>>>> the
>>>>>>>> category combinations. Check if you have more than one default
>>>>>>>> option
>>>>>>>> combination.
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> JM
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> El 23/08/2015, a las 11:36, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>> escribió:
>>>>>>>>
>>>>>>>>> Juan,
>>>>>>>>> Thanks for your response but we are not using custom forms for data
>>>>>>>>> entry.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> Gerald
>>>>>>>>>
>>>>>>>>> On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta"
>>>>>>>>> <jmalcantara1@xxxxxxxxx> wrote:
>>>>>>>>> Hello Gerald
>>>>>>>>> Are you using custom forms for data entry?
>>>>>>>>> JM
>>>>>>>>> El 22/08/2015, a las 15:37, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>>> escribió:
>>>>>>>>>
>>>>>>>>>> Dear dhis2-users,
>>>>>>>>>> If someone cannot help me; can anyone explain why am i having data
>>>>>>>>>> for
>>>>>>>>>> October, November, December 2015 on my database?
>>>>>>>>>>
>>>>>>>>>> dhis=# select * from period where startdate > '2015-01-01';
>>>>>>>>>> periodid | periodtypeid | startdate | enddate
>>>>>>>>>> ----------+--------------+------------+------------
>>>>>>>>>> 1121694 | 6 | 2016-01-01 | 2016-12-31
>>>>>>>>>> 2058605 | 3 | 2015-11-01 | 2015-11-30
>>>>>>>>>> 2058606 | 3 | 2015-12-01 | 2015-12-31
>>>>>>>>>> 2058607 | 3 | 2015-10-01 | 2015-10-31
>>>>>>>>>> 2058611 | 1 | 2015-01-16 | 2015-01-16
>>>>>>>>>> 2058619 | 1 | 2015-01-26 | 2015-01-26
>>>>>>>>>> 2058631 | 1 | 2015-01-29 | 2015-01-29
>>>>>>>>>> 2058632 | 3 | 2015-09-01 | 2015-09-30
>>>>>>>>>> 2058656 | 3 | 2015-02-01 | 2015-02-28
>>>>>>>>>> 2058727 | 3 | 2015-06-01 | 2015-06-30
>>>>>>>>>> 2058806 | 3 | 2015-07-01 | 2015-07-31
>>>>>>>>>> 2058811 | 2 | 2015-03-02 | 2015-03-08
>>>>>>>>>> 2058812 | 3 | 2015-03-01 | 2015-03-31
>>>>>>>>>> 2058814 | 3 | 2015-05-01 | 2015-05-31
>>>>>>>>>> 2065151 | 6 | 2020-01-01 | 2020-12-31
>>>>>>>>>> 2072304 | 3 | 2015-04-01 | 2015-04-30
>>>>>>>>>> 2109802 | 4 | 2015-04-01 | 2015-06-30
>>>>>>>>>> 2115342 | 3 | 2015-08-01 | 2015-08-31
>>>>>>>>>> 2122928 | 292091 | 2015-03-01 | 2015-04-30
>>>>>>>>>> 2129098 | 2 | 2015-05-25 | 2015-05-31
>>>>>>>>>> 2129099 | 1 | 2015-12-31 | 2015-12-31
>>>>>>>>>> Please we need to fix this issue of data loss; can anyone out
>>>>>>>>>> there
>>>>>>>>>> help
>>>>>>>>>> me.
>>>>>>>>>> Please !!!!!!!!!!!!!!!
>>>>>>>>>>
>>>>>>>>>> On 8/20/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>> Dear All,
>>>>>>>>>>> We are having a serious issues on our online server in Sierra
>>>>>>>>>>> Leone.
>>>>>>>>>>> Data are normally entered but during analysis these data normally
>>>>>>>>>>> got
>>>>>>>>>>> missing. This had been an issue i had raised before but the
>>>>>>>>>>> situation
>>>>>>>>>>> is still the same and it is even worst now.
>>>>>>>>>>>
>>>>>>>>>>> Please this is an urgent technical problem we need to fix for
>>>>>>>>>>> Sierra
>>>>>>>>>>> Leone and any help will be appreciated till we overcome this
>>>>>>>>>>> situation.
>>>>>>>>>>>
>>>>>>>>>>> Please help us!!!!!
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Regards,
>>>>>>>>>>>
>>>>>>>>>>> Gerald
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Regards,
>>>>>>>>>>
>>>>>>>>>> Gerald
>>>>>>>>>>
>>>>>>>>>> _______________________________________________
>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>> Post to : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>> More help : https://help.launchpad.net/ListHelp
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Regards,
>>>>>>>
>>>>>>> Gerald
>>>>>>> <Combo_Query result.txt>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> Regards,
>>>>
>>>> Gerald
>>>> <categoryoptioncombon.txt>
>>>
>>>
>>
>>
>> --
>> Regards,
>>
>> Gerald
>>
>
>
> --
> Regards,
>
> Gerald
References