← Back to team overview

dhis2-users team mailing list archive

Re: Data Loss

 

Dear Juan,
I am still having issues with datavalue query. Please can you help me
by checking the query again.
It is still giving

On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
> Hello Gerald
> What was the result of the datavalue query?
> You should also check the sharing settings of the data elements that are
> giving you trouble.
> JM
> El 24/08/2015, a las 08:43, gerald thomas <gerald17006@xxxxxxxxx> escribió:
>
>> Dear Juan,
>> Please find the attached updated combo query.
>>
>> On 8/24/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>> Dear Juan,
>>> Noted!!! It is now generating resource table and i will keep you
>>> posted once it had been completed
>>>
>>> On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx> wrote:
>>>> Select "Update category option combinations" and click on  "perform
>>>> maintenance". After that finished select from the menu of the left
>>>> "Resource
>>>> Table" and click on "Generate tables".
>>>> Regards,
>>>> JM
>>>>
>>>> El 24/08/2015, a las 08:00, gerald thomas <gerald17006@xxxxxxxxx>
>>>> escribió:
>>>>
>>>>> Dear Juan,
>>>>> Under Maintenance column i am seeing the following:
>>>>>
>>>>> Clear analytics tables
>>>>>
>>>>> Clear data mart
>>>>>
>>>>> Rebuild data mart index
>>>>>
>>>>> Clear zero values
>>>>>
>>>>> Clear data set completeness
>>>>>
>>>>> Prune periods
>>>>>
>>>>> Remove expired invitations
>>>>>
>>>>> Drop SQL views
>>>>>
>>>>> Create SQL views
>>>>>
>>>>> Update category option combinations
>>>>>
>>>>> What should I check for the performance maintenance before doing the
>>>>> query again?
>>>>>
>>>>> On 8/24/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>>>> Dear Juan,
>>>>>> No!!! This is the holistic data from that query. Previously i only
>>>>>> had
>>>>>> the first part of the result. Do you want me to rebuild tables and
>>>>>> run
>>>>>> query again?
>>>>>>
>>>>>> On 8/24/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>>> wrote:
>>>>>>> Hello Gerald
>>>>>>> This looks much different than the fist one you sent me and it's
>>>>>>> still
>>>>>>> missing a lot of names, did you rebuild resource tables?
>>>>>>> JM
>>>>>>>
>>>>>>> El 24/08/2015, a las 05:44, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>> escribió:
>>>>>>>
>>>>>>>> Dear Juan,
>>>>>>>> Thanks for your responses.
>>>>>>>> Sorry i am only responding now but please find the attached
>>>>>>>> category
>>>>>>>> combo query.
>>>>>>>>
>>>>>>>> On 8/23/15, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx>
>>>>>>>> wrote:
>>>>>>>>> Sorry, I got distracted and hit send before completing the
>>>>>>>>> message.
>>>>>>>>>
>>>>>>>>> You should limit the query to show the values of the specific data
>>>>>>>>> elements
>>>>>>>>> that are giving you trouble, you'll need the uid of each of the
>>>>>>>>> data
>>>>>>>>> element., In case you don't know how to get that information, you
>>>>>>>>> can
>>>>>>>>> use
>>>>>>>>> the api (your_server_URL/api/dataElements?paging=false) or look at
>>>>>>>>> the
>>>>>>>>> information if each data element in data element management
>>>>>>>>> selecting
>>>>>>>>> "show
>>>>>>>>> details" from the contextual menu that appears when clocking on
>>>>>>>>> the
>>>>>>>>> name
>>>>>>>>> of
>>>>>>>>> each data element. Then add to the query the list of UIDs just
>>>>>>>>> before
>>>>>>>>> the
>>>>>>>>> semicolon.
>>>>>>>>>
>>>>>>>>> WHERE de.uid IN
>>>>>>>>> ('UID1','UID2','UID3','UID4','UID5','UID6','UID7','UID8','UID9','UID10')
>>>>>>>>>
>>>>>>>>> Please excuse me if you already know all of these things, since I
>>>>>>>>> don't
>>>>>>>>> have
>>>>>>>>> a way to know how much you know about the system and postgres
>>>>>>>>> queries
>>>>>>>>> I
>>>>>>>>> rather be detailed on what you have to do than leave you guessing.
>>>>>>>>>
>>>>>>>>> In addition to running maintenance to update category option
>>>>>>>>> combinations
>>>>>>>>> you should re-generate resource tables, you'll find that in "Data
>>>>>>>>> Administration" too.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>> JM
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> El 23/08/2015, a las 16:18, Juan Manuel Alcantara Acosta
>>>>>>>>> <jmalcantara1@xxxxxxxxx> escribió:
>>>>>>>>>
>>>>>>>>>> Hi Gerald
>>>>>>>>>> I see you are missing a few category option combo names, you
>>>>>>>>>> should
>>>>>>>>>> run
>>>>>>>>>> the maintenance to "Update category option combinations", you'll
>>>>>>>>>> find
>>>>>>>>>> this
>>>>>>>>>> in "Data Administration" -> "maintenance"
>>>>>>>>>> I also don't see the option combinations of the data elements you
>>>>>>>>>> highlighted in the excel you sent to the list. Which category
>>>>>>>>>> combination
>>>>>>>>>> are you using with those data elements? Run the query again after
>>>>>>>>>> doing
>>>>>>>>>> the maintenance.
>>>>>>>>>>
>>>>>>>>>> <15 yrs, 15-24yrs, 25-34yrs, 35-44yrs, 45-49yrs, >49yrs
>>>>>>>>>>
>>>>>>>>>> About the out of memory error, I recommend that you use pgAdmin3
>>>>>>>>>> and
>>>>>>>>>> try
>>>>>>>>>> to run the query again. You should limit the query to show you
>>>>>>>>>> the
>>>>>>>>>> data
>>>>>>>>>>
>>>>>>>>>> El 23/08/2015, a las 15:39, gerald thomas <gerald17006@xxxxxxxxx>
>>>>>>>>>> escribió:
>>>>>>>>>>
>>>>>>>>>>> Dear Juan,
>>>>>>>>>>> For the datavalues query; i am getting "Out of memory" as
>>>>>>>>>>> result.
>>>>>>>>>>> Please find the attached result for the combo query.
>>>>>>>>>>>
>>>>>>>>>>> On 8/23/15, Juan Manuel Alcantara Acosta
>>>>>>>>>>> <jmalcantara1@xxxxxxxxx>
>>>>>>>>>>> wrote:
>>>>>>>>>>>> Hello Gerald
>>>>>>>>>>>> Does data disappear only from data elements that use the
>>>>>>>>>>>> default
>>>>>>>>>>>> category
>>>>>>>>>>>> combination?
>>>>>>>>>>>> Since you are querying your database directly, I'm sending you
>>>>>>>>>>>> here
>>>>>>>>>>>> a
>>>>>>>>>>>> couple
>>>>>>>>>>>> of queries you can use to verify the existing values of the
>>>>>>>>>>>> database
>>>>>>>>>>>> and
>>>>>>>>>>>> the
>>>>>>>>>>>> category combinations. Check if you have more than one default
>>>>>>>>>>>> option
>>>>>>>>>>>> combination.
>>>>>>>>>>>>
>>>>>>>>>>>> Regards,
>>>>>>>>>>>> JM
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>> El 23/08/2015, a las 11:36, gerald thomas
>>>>>>>>>>>> <gerald17006@xxxxxxxxx>
>>>>>>>>>>>> escribió:
>>>>>>>>>>>>
>>>>>>>>>>>>> Juan,
>>>>>>>>>>>>> Thanks for your response but we are not using custom forms for
>>>>>>>>>>>>> data
>>>>>>>>>>>>> entry.
>>>>>>>>>>>>>
>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>> Gerald
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta"
>>>>>>>>>>>>> <jmalcantara1@xxxxxxxxx> wrote:
>>>>>>>>>>>>> Hello Gerald
>>>>>>>>>>>>> Are you using custom forms for data entry?
>>>>>>>>>>>>> JM
>>>>>>>>>>>>> El 22/08/2015, a las 15:37, gerald thomas
>>>>>>>>>>>>> <gerald17006@xxxxxxxxx>
>>>>>>>>>>>>> escribió:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> Dear dhis2-users,
>>>>>>>>>>>>>> If someone cannot help me; can anyone explain why am i having
>>>>>>>>>>>>>> data
>>>>>>>>>>>>>> for
>>>>>>>>>>>>>> October, November, December 2015 on my database?
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> dhis=# select * from period where startdate > '2015-01-01';
>>>>>>>>>>>>>> periodid | periodtypeid | startdate  |  enddate
>>>>>>>>>>>>>> ----------+--------------+------------+------------
>>>>>>>>>>>>>> 1121694 |            6 | 2016-01-01 | 2016-12-31
>>>>>>>>>>>>>> 2058605 |            3 | 2015-11-01 | 2015-11-30
>>>>>>>>>>>>>> 2058606 |            3 | 2015-12-01 | 2015-12-31
>>>>>>>>>>>>>> 2058607 |            3 | 2015-10-01 | 2015-10-31
>>>>>>>>>>>>>> 2058611 |            1 | 2015-01-16 | 2015-01-16
>>>>>>>>>>>>>> 2058619 |            1 | 2015-01-26 | 2015-01-26
>>>>>>>>>>>>>> 2058631 |            1 | 2015-01-29 | 2015-01-29
>>>>>>>>>>>>>> 2058632 |            3 | 2015-09-01 | 2015-09-30
>>>>>>>>>>>>>> 2058656 |            3 | 2015-02-01 | 2015-02-28
>>>>>>>>>>>>>> 2058727 |            3 | 2015-06-01 | 2015-06-30
>>>>>>>>>>>>>> 2058806 |            3 | 2015-07-01 | 2015-07-31
>>>>>>>>>>>>>> 2058811 |            2 | 2015-03-02 | 2015-03-08
>>>>>>>>>>>>>> 2058812 |            3 | 2015-03-01 | 2015-03-31
>>>>>>>>>>>>>> 2058814 |            3 | 2015-05-01 | 2015-05-31
>>>>>>>>>>>>>> 2065151 |            6 | 2020-01-01 | 2020-12-31
>>>>>>>>>>>>>> 2072304 |            3 | 2015-04-01 | 2015-04-30
>>>>>>>>>>>>>> 2109802 |            4 | 2015-04-01 | 2015-06-30
>>>>>>>>>>>>>> 2115342 |            3 | 2015-08-01 | 2015-08-31
>>>>>>>>>>>>>> 2122928 |       292091 | 2015-03-01 | 2015-04-30
>>>>>>>>>>>>>> 2129098 |            2 | 2015-05-25 | 2015-05-31
>>>>>>>>>>>>>> 2129099 |            1 | 2015-12-31 | 2015-12-31
>>>>>>>>>>>>>> Please we need to fix this issue of data loss; can anyone out
>>>>>>>>>>>>>> there
>>>>>>>>>>>>>> help
>>>>>>>>>>>>>> me.
>>>>>>>>>>>>>> Please !!!!!!!!!!!!!!!
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On 8/20/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>>>>>>>>>>>>> Dear All,
>>>>>>>>>>>>>>> We are having a serious issues on our online server in
>>>>>>>>>>>>>>> Sierra
>>>>>>>>>>>>>>> Leone.
>>>>>>>>>>>>>>> Data are normally entered but during analysis these data
>>>>>>>>>>>>>>> normally
>>>>>>>>>>>>>>> got
>>>>>>>>>>>>>>> missing. This had been an issue i had raised before but the
>>>>>>>>>>>>>>> situation
>>>>>>>>>>>>>>> is still the same and it is even worst now.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Please this is an urgent technical problem we need to fix
>>>>>>>>>>>>>>> for
>>>>>>>>>>>>>>> Sierra
>>>>>>>>>>>>>>> Leone and any help will be appreciated till we overcome this
>>>>>>>>>>>>>>> situation.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Please help us!!!!!
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --
>>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Gerald
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --
>>>>>>>>>>>>>> Regards,
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Gerald
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> _______________________________________________
>>>>>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> Regards,
>>>>>>>>>>>
>>>>>>>>>>> Gerald
>>>>>>>>>>> <Combo_Query result.txt>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> Regards,
>>>>>>>>
>>>>>>>> Gerald
>>>>>>>> <categoryoptioncombon.txt>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> Regards,
>>>>>>
>>>>>> Gerald
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> Regards,
>>>>>
>>>>> Gerald
>>>>
>>>>
>>>
>>>
>>> --
>>> Regards,
>>>
>>> Gerald
>>>
>>
>>
>> --
>> Regards,
>>
>> Gerald
>> <New_categoryoptioncombon.txt>
>
>


-- 
Regards,

Gerald


References