dhis2-devs team mailing list archive
-
dhis2-devs team
-
Mailing list archive
-
Message #39091
Re: [Dhis2-users] Data Loss
Hello Gerald
What was the result of the datavalue query?
You should also check the sharing settings of the data elements that are giving you trouble.
JM
El 24/08/2015, a las 08:43, gerald thomas <gerald17006@xxxxxxxxx> escribió:
> Dear Juan,
> Please find the attached updated combo query.
>
> On 8/24/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>> Dear Juan,
>> Noted!!! It is now generating resource table and i will keep you
>> posted once it had been completed
>>
>> On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>>> Select "Update category option combinations" and click on "perform
>>> maintenance". After that finished select from the menu of the left
>>> "Resource
>>> Table" and click on "Generate tables".
>>> Regards,
>>> JM
>>>
>>> El 24/08/2015, a las 08:00, gerald thomas <gerald17006@xxxxxxxxx>
>>> escribió:
>>>
>>>> Dear Juan,
>>>> Under Maintenance column i am seeing the following:
>>>>
>>>> Clear analytics tables
>>>>
>>>> Clear data mart
>>>>
>>>> Rebuild data mart index
>>>>
>>>> Clear zero values
>>>>
>>>> Clear data set completeness
>>>>
>>>> Prune periods
>>>>
>>>> Remove expired invitations
>>>>
>>>> Drop SQL views
>>>>
>>>> Create SQL views
>>>>
>>>> Update category option combinations
>>>>
>>>> What should I check for the performance maintenance before doing the
>>>> query again?
>>>>
>>>> On 8/24/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>>> Dear Juan,
>>>>> No!!! This is the holistic data from that query. Previously i only had
>>>>> the first part of the result. Do you want me to rebuild tables and run
>>>>> query again?
>>>>>
>>>>> On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>> wrote:
>>>>>> Hello Gerald
>>>>>> This looks much different than the fist one you sent me and it's still
>>>>>> missing a lot of names, did you rebuild resource tables?
>>>>>> JM
>>>>>>
>>>>>> El 24/08/2015, a las 05:44, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>> escribió:
>>>>>>
>>>>>>> Dear Juan,
>>>>>>> Thanks for your responses.
>>>>>>> Sorry i am only responding now but please find the attached category
>>>>>>> combo query.
>>>>>>>
>>>>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>>>> wrote:
>>>>>>>> Sorry, I got distracted and hit send before completing the message.
>>>>>>>>
>>>>>>>> You should limit the query to show the values of the specific data
>>>>>>>> elements
>>>>>>>> that are giving you trouble, you'll need the uid of each of the data
>>>>>>>> element., In case you don't know how to get that information, you
>>>>>>>> can
>>>>>>>> use
>>>>>>>> the api (your_server_URL/api/dataElements?paging=false) or look at
>>>>>>>> the
>>>>>>>> information if each data element in data element management
>>>>>>>> selecting
>>>>>>>> "show
>>>>>>>> details" from the contextual menu that appears when clocking on the
>>>>>>>> name
>>>>>>>> of
>>>>>>>> each data element. Then add to the query the list of UIDs just
>>>>>>>> before
>>>>>>>> the
>>>>>>>> semicolon.
>>>>>>>>
>>>>>>>> WHERE de.uid IN
>>>>>>>> ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')
>>>>>>>>
>>>>>>>> Please excuse me if you already know all of these things, since I
>>>>>>>> don't
>>>>>>>> have
>>>>>>>> a way to know how much you know about the system and postgres
>>>>>>>> queries
>>>>>>>> I
>>>>>>>> rather be detailed on what you have to do than leave you guessing.
>>>>>>>>
>>>>>>>> In addition to running maintenance to update category option
>>>>>>>> combinations
>>>>>>>> you should re-generate resource tables, you'll find that in "Data
>>>>>>>> Administration" too.
>>>>>>>>
>>>>>>>>
>>>>>>>> Regards,
>>>>>>>> JM
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta
>>>>>>>> <jmalcantara1@xxxxxxxxx> escribió:
>>>>>>>>
>>>>>>>>> Hi Gerald
>>>>>>>>> I see you are missing a few category option combo names, you should
>>>>>>>>> run
>>>>>>>>> the maintenance to "Update category option combinations", you'll
>>>>>>>>> find
>>>>>>>>> this
>>>>>>>>> in "Data Administration" -> "maintenance"
>>>>>>>>> I also don't see the option combinations of the data elements you
>>>>>>>>> highlighted in the excel you sent to the list. Which category
>>>>>>>>> combination
>>>>>>>>> are you using with those data elements? Run the query again after
>>>>>>>>> doing
>>>>>>>>> the maintenance.
>>>>>>>>>
>>>>>>>>> <15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs
>>>>>>>>>
>>>>>>>>> About the out of memory error, I recommend that you use pgAdmin3
>>>>>>>>> and
>>>>>>>>> try
>>>>>>>>> to run the query again. You should limit the query to show you the
>>>>>>>>> data
>>>>>>>>>
>>>>>>>>> El 23/08/2015, a las 15:39, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>>> escribió:
>>>>>>>>>
>>>>>>>>>> Dear Juan,
>>>>>>>>>> For the datavalues query; i am getting "Out of memory" as result.
>>>>>>>>>> Please find the attached result for the combo query.
>>>>>>>>>>
>>>>>>>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>>>>>>> wrote:
>>>>>>>>>>> Hello Gerald
>>>>>>>>>>> Does data disappear only from data elements that use the default
>>>>>>>>>>> category
>>>>>>>>>>> combination?
>>>>>>>>>>> Since you are querying your database directly, I'm sending you
>>>>>>>>>>> here
>>>>>>>>>>> a
>>>>>>>>>>> couple
>>>>>>>>>>> of queries you can use to verify the existing values of the
>>>>>>>>>>> database
>>>>>>>>>>> and
>>>>>>>>>>> the
>>>>>>>>>>> category combinations. Check if you have more than one default
>>>>>>>>>>> option
>>>>>>>>>>> combination.
>>>>>>>>>>>
>>>>>>>>>>> Regards,
>>>>>>>>>>> JM
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> El 23/08/2015, a las 11:36, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>>>>> escribió:
>>>>>>>>>>>
>>>>>>>>>>>> Juan,
>>>>>>>>>>>> Thanks for your response but we are not using custom forms for
>>>>>>>>>>>> data
>>>>>>>>>>>> entry.
>>>>>>>>>>>>
>>>>>>>>>>>> Regards,
>>>>>>>>>>>> Gerald
>>>>>>>>>>>>
>>>>>>>>>>>> On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta"
>>>>>>>>>>>> <jmalcantara1@xxxxxxxxx> wrote:
>>>>>>>>>>>> Hello Gerald
>>>>>>>>>>>> Are you using custom forms for data entry?
>>>>>>>>>>>> JM
>>>>>>>>>>>> El 22/08/2015, a las 15:37, gerald thomas
>>>>>>>>>>>> <gerald17006@xxxxxxxxx>
>>>>>>>>>>>> escribió:
>>>>>>>>>>>>
>>>>>>>>>>>>> Dear dhis2-users,
>>>>>>>>>>>>> If someone cannot help me; can anyone explain why am i having
>>>>>>>>>>>>> data
>>>>>>>>>>>>> for
>>>>>>>>>>>>> October, November, December 2015 on my database?
>>>>>>>>>>>>>
>>>>>>>>>>>>> dhis=# select * from period where startdate > '2015-01-01';
>>>>>>>>>>>>> periodid | periodtypeid | startdate | enddate
>>>>>>>>>>>>> ----------+--------------+------------+------------
>>>>>>>>>>>>> 1121694 | 6 | 2016-01-01 | 2016-12-31
>>>>>>>>>>>>> 2058605 | 3 | 2015-11-01 | 2015-11-30
>>>>>>>>>>>>> 2058606 | 3 | 2015-12-01 | 2015-12-31
>>>>>>>>>>>>> 2058607 | 3 | 2015-10-01 | 2015-10-31
>>>>>>>>>>>>> 2058611 | 1 | 2015-01-16 | 2015-01-16
>>>>>>>>>>>>> 2058619 | 1 | 2015-01-26 | 2015-01-26
>>>>>>>>>>>>> 2058631 | 1 | 2015-01-29 | 2015-01-29
>>>>>>>>>>>>> 2058632 | 3 | 2015-09-01 | 2015-09-30
>>>>>>>>>>>>> 2058656 | 3 | 2015-02-01 | 2015-02-28
>>>>>>>>>>>>> 2058727 | 3 | 2015-06-01 | 2015-06-30
>>>>>>>>>>>>> 2058806 | 3 | 2015-07-01 | 2015-07-31
>>>>>>>>>>>>> 2058811 | 2 | 2015-03-02 | 2015-03-08
>>>>>>>>>>>>> 2058812 | 3 | 2015-03-01 | 2015-03-31
>>>>>>>>>>>>> 2058814 | 3 | 2015-05-01 | 2015-05-31
>>>>>>>>>>>>> 2065151 | 6 | 2020-01-01 | 2020-12-31
>>>>>>>>>>>>> 2072304 | 3 | 2015-04-01 | 2015-04-30
>>>>>>>>>>>>> 2109802 | 4 | 2015-04-01 | 2015-06-30
>>>>>>>>>>>>> 2115342 | 3 | 2015-08-01 | 2015-08-31
>>>>>>>>>>>>> 2122928 | 292091 | 2015-03-01 | 2015-04-30
>>>>>>>>>>>>> 2129098 | 2 | 2015-05-25 | 2015-05-31
>>>>>>>>>>>>> 2129099 | 1 | 2015-12-31 | 2015-12-31
>>>>>>>>>>>>> Please we need to fix this issue of data loss; can anyone out
>>>>>>>>>>>>> there
>>>>>>>>>>>>> help
>>>>>>>>>>>>> me.
>>>>>>>>>>>>> Please !!!!!!!!!!!!!!!
>>>>>>>>>>>>>
>>>>>>>>>>>>> On 8/20/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>>>>> Dear All,
>>>>>>>>>>>>>> We are having a serious issues on our online server in Sierra
>>>>>>>>>>>>>> Leone.
>>>>>>>>>>>>>> Data are normally entered but during analysis these data
>>>>>>>>>>>>>> normally
>>>>>>>>>>>>>> got
>>>>>>>>>>>>>> missing. This had been an issue i had raised before but the
>>>>>>>>>>>>>> situation
>>>>>>>>>>>>>> is still the same and it is even worst now.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Please this is an urgent technical problem we need to fix for
>>>>>>>>>>>>>> Sierra
>>>>>>>>>>>>>> Leone and any help will be appreciated till we overcome this
>>>>>>>>>>>>>> situation.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Please help us!!!!!
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Gerald
>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --
>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>
>>>>>>>>>>>>> Gerald
>>>>>>>>>>>>>
>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>>>>> Post to : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>>>>> More help : https://help.launchpad.net/ListHelp
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> Regards,
>>>>>>>>>>
>>>>>>>>>> Gerald
>>>>>>>>>> <Combo_Query result.txt>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> Regards,
>>>>>>>
>>>>>>> Gerald
>>>>>>> <categoryoptioncombon.txt>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Regards,
>>>>>
>>>>> Gerald
>>>>>
>>>>
>>>>
>>>> --
>>>> Regards,
>>>>
>>>> Gerald
>>>
>>>
>>
>>
>> --
>> Regards,
>>
>> Gerald
>>
>
>
> --
> Regards,
>
> Gerald
> <New_categoryoptioncombon.txt>
Follow ups
References