← Back to team overview

dhis2-users team mailing list archive

Re: Data Loss

 

Dear All,
Thanks for all your responses.
Please find the attached forms in excel which will make my explanation
much easier.
Data loss normally occur on HF1 & HF8 and it is on a particular
sections of these forms.
The said sections of these forms had been highlighted in yellow.

Once data had been entered and submitted by clicking "complete"; If
analysis is done after or the next day those highlighted sections will
remain blank.

Ant,
1. Before i was worried about those future dates but with your
explanation i am not too worried. But is there anyway we can stop it.
2. I am sure i had explained much better my scenario above and if you
have any further question i will be ready to answer and give you
update.

3. For this question i am not sure we have any custom period and i
can't really explain this "periodtypeid of  292091"

4. With reference to batch process, we only have data analytic which
runs at a certain period at night.

Thanks in advance for your usual cooperation.


On 8/23/15, Ant Snyman <ant@xxxxxxxx> wrote:
> Hi Gerald,
> Could you please just clarify what exactly your question is?
> 1. You have provided a list from you period table. When data is captured or
> imported into DHIS2 and a period does not exist, then an entry is created
> in the period table. The period table does not contain data, only periods
> associated with data that has been captured. Are you concerned because
> periods exist with future dates?
> 2. The data is stored in the datavalue table if you are capturing
> aggregated data. You mention data loss? Has data been captured and you have
> verified that the data actually is stored in the datavalue table and then
> afterwards the data disappears when you do analysis? Or does it appear as
> if the data is physically captured but then never gets stored in the
> datavalue table?
> 3. The periodtypeid of  292091 is really odd - is it a custom period that
> you inserted into the period table yourself?
>
> I would suggest (based on the limited knowledge of what is going on at your
> site) that you follow the whole process and verify each step: Verify the
> data is captured correctly and completely and saved. Then verify that that
> specific piece of data exists in the datavalue table with the right
> dataelement, period and org unit. If the data gets lost between the data
> entry and the datavalue table, then there is a problem with the completion
> of the data capture transaction. If data does land up in the datavalue
> table, but subsequently disappears, then there might be a batch job running
> that "cleans out" your datavalue table, but that is most unlikely. If you
> can't see your data on the reporting side even though the data exists in
> the datavalue table, then the issue is with the reporting side where you
> need to specify the correct dataelements, periods and org units to see the
> data.
>
> And this is as much input as I can give with the information you have
> provided.
>
> Regards
>
>
>
> Regards
> Ant Snyman
>
>
> On 23 August 2015 at 18:36, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>
>> Juan,
>> Thanks for your response but we are not using custom forms for data
>> entry.
>>
>> Regards,
>> Gerald
>> On Aug 23, 2015 4:29 PM, "Juan Manuel Alcantara Acosta" <
>> jmalcantara1@xxxxxxxxx> wrote:
>>
>>> Hello Gerald
>>> Are you using custom forms for data entry?
>>> JM
>>> El 22/08/2015, a las 15:37, gerald thomas <gerald17006@xxxxxxxxx>
>>> escribió:
>>>
>>> Dear dhis2-users,
>>> If someone cannot help me; can anyone explain why am i having data for
>>> October, November, December 2015 on my database?
>>>
>>> dhis=# select * from period where startdate > '2015-01-01';
>>> periodid | periodtypeid | startdate  |  enddate
>>> ----------+--------------+------------+------------
>>>  1121694 |            6 | 2016-01-01 | 2016-12-31
>>>  2058605 |            3 | 2015-11-01 | 2015-11-30
>>>  2058606 |            3 | 2015-12-01 | 2015-12-31
>>>  2058607 |            3 | 2015-10-01 | 2015-10-31
>>>  2058611 |            1 | 2015-01-16 | 2015-01-16
>>>  2058619 |            1 | 2015-01-26 | 2015-01-26
>>>  2058631 |            1 | 2015-01-29 | 2015-01-29
>>>  2058632 |            3 | 2015-09-01 | 2015-09-30
>>>  2058656 |            3 | 2015-02-01 | 2015-02-28
>>>  2058727 |            3 | 2015-06-01 | 2015-06-30
>>>  2058806 |            3 | 2015-07-01 | 2015-07-31
>>>  2058811 |            2 | 2015-03-02 | 2015-03-08
>>>  2058812 |            3 | 2015-03-01 | 2015-03-31
>>>  2058814 |            3 | 2015-05-01 | 2015-05-31
>>>  2065151 |            6 | 2020-01-01 | 2020-12-31
>>>  2072304 |            3 | 2015-04-01 | 2015-04-30
>>>  2109802 |            4 | 2015-04-01 | 2015-06-30
>>>  2115342 |            3 | 2015-08-01 | 2015-08-31
>>>  2122928 |       292091 | 2015-03-01 | 2015-04-30
>>>  2129098 |            2 | 2015-05-25 | 2015-05-31
>>>  2129099 |            1 | 2015-12-31 | 2015-12-31
>>> Please we need to fix this issue of data loss; can anyone out there help
>>> me.
>>> Please !!!!!!!!!!!!!!!
>>>
>>> On 8/20/15, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>>>
>>> Dear All,
>>> We are having a serious issues on our online server in Sierra Leone.
>>> Data are normally entered but during analysis these data normally got
>>> missing. This had been an issue i had raised before but the situation
>>> is still the same and it is even worst now.
>>>
>>> Please this is an urgent technical problem we need to fix for Sierra
>>> Leone and any help will be appreciated till we overcome this
>>> situation.
>>>
>>> Please help us!!!!!
>>>
>>> --
>>> Regards,
>>>
>>> Gerald
>>>
>>>
>>>
>>> --
>>> Regards,
>>>
>>> Gerald
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-users
>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~dhis2-users
>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~dhis2-users
>> More help   : https://help.launchpad.net/ListHelp
>>
>>
>
>
> --
>
> *Ant Snyman*
>
> *Cell: 0824910449*
>
> *Landline: 028 2713242*
>
>
> Health Information Systems Program - SA
>
> --
>
>
> *This message and any attachments are subject to a disclaimer published at
> http://www.hisp.org/policies.html#comms_disclaimer
> <http://www.hisp.org/policies.html#comms_disclaimer>.  Please read the
> disclaimer before opening any attachment or taking any other action in
> terms of this electronic transmission.  If you cannot access the
> disclaimer, kindly send an email to disclaimer@xxxxxxxx
> <disclaimer@xxxxxxxx> and a copy will be provided to you. By replying to
> this e-mail or opening any attachment you agree to be bound by the
> provisions of the disclaimer.*
>


-- 
Regards,

Gerald

Attachment: blank hmis forms.xls
Description: MS-Excel spreadsheet


Follow ups

References