dhis2-devs team mailing list archive

[Calle Hedberg <calle.hedberg@xxxxxxxxx>]

Gerald,

Firstly, I've verified this morning that there are no duplicates in the
datavalue table. I was 99.9% sure of that since the primary key was in
place, but to verify I created an exact duplicate called "datavalue2" with
the same primary key and copied all the records across.

Secondly, those errors might be log errors linked to some of the clean-up
work we did on Thursday/Friday. The errors were probably triggered by me
trying to insert some few data values via ODBC and failing due to those
duplicates (i.e. no records inserted). There's no reason to be concerned
about those.

So unless those log errors should re-appear for some reason, there is no
problem.

Regards
Calle

On 30 January 2017 at 12:25, Bob Jolliffe <bobjolliffe@xxxxxxxxx> wrote:

> Morning Gerald.  No this error would have nothing to do with importing
> metadata or metadata that was previously imported as far as I can think.
>
> It is purely about duplicate reporting of data.  Usually two identical
> rows in the batch you are importing.  Which is why I ask where you got this
> data from that you imported?  If it was data exported from another dhis2
> system you wouldn't normally see this.  But if is from somewhere else (a
> spreadsheet, ihris, some other system) there might be, for example,
> duplicate orgunits in the batch.
>
> On 30 January 2017 at 09:54, gerald thomas <gerald17006@xxxxxxxxx> wrote:
>
>> Good morning all,
>>
>> Bob, at some point Calle was importing metadata but i don't know if
>> that should be an issue. I am currently monitoring the logs to see if
>> i will receive those errors again.
>>
>> On 1/28/17, Seid Hussein <seid.hisp@xxxxxxxxx> wrote:
>> > Hi Gerald,
>> >
>> > You can use the (insert if not exists) query to insert your data. But
>> > unlike the COPY function which allows bulk insert, you have to write an
>> > insert statement for each data value you intend to insert.
>> >
>> > Regards,
>> >
>> >
>> > Seid,
>> >
>> > On Saturday, January 28, 2017, Bob Jolliffe <bobjolliffe@xxxxxxxxx>
>> wrote:
>> >
>> >> where does the data come from that you try to import?
>> >>
>> >> On 28 January 2017 at 19:55, gerald thomas <gerald17006@xxxxxxxxx
>> >> <javascript:_e(%7B%7D,'cvml','gerald17006@xxxxxxxxx');>> wrote:
>> >>
>> >>> Funnily I Bob I only copied a section of the log, I have various
>> >>> dataelements ids & period ids which are sending those errors.
>> >>> So I am worried where are these errors coming from now.
>> >>>
>> >>> On Jan 28, 2017 7:31 PM, "Bob Jolliffe" <bobjolliffe@xxxxxxxxx
>> >>> <javascript:_e(%7B%7D,'cvml','bobjolliffe@xxxxxxxxx');>> wrote:
>> >>>
>> >>> Gerald the clue is in your error message:
>> >>>
>> >>> Detail: Key (dataelementid, periodid, sourceid,categoryoptioncomboid,
>> >>> attributeoptioncomboid)=(1973, 2784149, 301,13, 13) already exists.
>> >>>
>> >>> This usually means you have duplicates among the datavalues you are
>> >>> trying to import.  ie. more than one row with the key values as shown
>> in
>> >>> your error message.
>> >>>
>> >>> On 28 January 2017 at 19:02, gerald thomas <gerald17006@xxxxxxxxx
>> >>> <javascript:_e(%7B%7D,'cvml','gerald17006@xxxxxxxxx');>> wrote:
>> >>>
>> >>>> Seid,
>> >>>> Thanks for your help but how can i identify those dataelements:
>> >>>>
>> >>>> So I suggest you either to use the web API and import through the
>> >>>> import/export module or find out which of the metadata IDs is
>> >>>> duplicate and correct it.
>> >>>>
>> >>>> On 1/28/17, Seid Hussein <seid.hisp@xxxxxxxxx
>> >>>> <javascript:_e(%7B%7D,'cvml','seid.hisp@xxxxxxxxx');>> wrote:
>> >>>> > Hi Gerald,
>> >>>> >
>> >>>> > I believe you're trying to import through the database rather than
>> >>>> > the
>> >>>> API
>> >>>> > which is a better option because of you've duplicate there the most
>> >>>> > probable action ta update rather than a duplicate error.
>> >>>> >
>> >>>> > Most probably what happened is you have duplicate metadata. Each
>> data
>> >>>> value
>> >>>> > shall have a unique combination of data element id, period id, org
>> >>>> unit id,
>> >>>> > category option combo id, and attribute option combo id.
>> >>>> >
>> >>>> > So I suggest you either to use the web API and import through the
>> >>>> > import/export module or find out which of the metadata IDs is
>> >>>> duplicate and
>> >>>> > correct it.
>> >>>> >
>> >>>> > Regards,
>> >>>> >
>> >>>> >
>> >>>> > Seid,
>> >>>> >
>> >>>> > On Friday, January 27, 2017, gerald thomas <gerald17006@xxxxxxxxx
>> >>>> <javascript:_e(%7B%7D,'cvml','gerald17006@xxxxxxxxx');>> wrote:
>> >>>> >
>> >>>> >> Dear All,
>> >>>> >>
>> >>>> >> What is the meaning of this error:
>> >>>> >>
>> >>>> >> * ERROR 2017-01-05 12:03:07,593 ERROR: duplicate key value
>> violates
>> >>>> >> unique constraint "datavalue_pkey"
>> >>>> >>   Detail: Key (dataelementid, periodid, sourceid,
>> >>>> >> categoryoptioncomboid, attributeoptioncomboid)=(1973, 2784149,
>> 301,
>> >>>> >> 13, 13) already exists.
>> >>>> >>
>> >>>> >> Please find the attached copy of catalina.out log file
>> >>>> >>
>> >>>> >> --
>> >>>> >> Regards,
>> >>>> >>
>> >>>> >> Gerald
>> >>>> >>
>> >>>> >
>> >>>>
>> >>>>
>> >>>> --
>> >>>> Regards,
>> >>>>
>> >>>> Gerald
>> >>>>
>> >>>> _______________________________________________
>> >>>> Mailing list: https://launchpad.net/~dhis2-users
>> >>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>> >>>> <javascript:_e(%7B%7D,'cvml','dhis2-users@xxxxxxxxxxxxxxxxxxx');>
>> >>>> Unsubscribe : https://launchpad.net/~dhis2-users
>> >>>> More help   : https://help.launchpad.net/ListHelp
>> >>>>
>> >>>
>> >>>
>> >>>
>> >>
>> >
>>
>>
>> --
>> Regards,
>>
>> Gerald
>>
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp
>
>


-- 

*******************************************

Calle Hedberg

46D Alma Road, 7700 Rosebank, SOUTH AFRICA

Tel/fax (home): +27-21-685-6472

Cell: +27-82-853-5352

Iridium SatPhone: +8816-315-19119

Email: calle.hedberg@xxxxxxxxx

Skype: calle_hedberg

*******************************************