← Back to team overview

dhis2-users team mailing list archive

Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE

 

Hi all – thank for your support and suggestions.

We managed to find a solution to our problem. We downgraded to version 2.29 and found a good balance between using the new Android app together with import functionalities.
For importing Org Units through a .csv file in version 2.30 – I will say that it was not possible after all. We tried many different combinations for creating the .csv files and none was successful. Together with the fact that some of the Org Unit csv files have been successfully imported in versions 2.25 – 2.29

Regards and thank you all
Kris

From: Viet Nguyen [mailto:viet@xxxxxxxxx]
Sent: Friday, November 2, 2018 10:24 AM
To: dcocos@xxxxxxxxxxxxxx
Cc: Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx>; dhis2-users <dhis2-users@xxxxxxxxxxxxxxxxxxx>; Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx>; dhis2-devs <dhis2-devs@xxxxxxxxxxxxxxxxxxx>
Subject: Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE

Hi Georgi and Kristiyan,

Could you try to change the file extension from ".CSV" to lowercase and import again ? I think this is a bug, already reported to the app developer and he's fixing it.

We also have added the import summary which will show all the import errors. It's on master and being backported to 2.30.

Regards,





On Fri, Nov 2, 2018 at 5:04 AM Dan Cocos <dcocos@xxxxxxxxxxxxxx<mailto:dcocos@xxxxxxxxxxxxxx>> wrote:
Is it encoded as UTF-8? I noticed as few “special” charters and that might cause problems.

Dan Cocos
BAO Systems
On Nov 1, 2018, at 5:33 PM, Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx<mailto:georgi@xxxxxxxxxxxxxxxxxxx>> wrote:
Hi Blake,

Thanks for your response!

I am a colleague of Kristiyan. We use csv format as we have always used for DHIS2 versions 2.28 and below.
So it seems that DHIS2 changed standards for csv for some reason. The exact same csv that Kris sent you was used to import org units in 2.28 instance and now is not recognized. We compared the template layout in 2.30 and it matches a 100% our file. I have also tried a csv export software with different options of csv files with no luck.

Maybe you could advice on how you generate csv files?

Regards,
Georgi

From: Blake Hansen <bhansen@xxxxxxxxxxxxxx<mailto:bhansen@xxxxxxxxxxxxxx>>
Sent: Thursday, November 1, 2018 7:17 PM
To: Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx<mailto:Kristiyan@xxxxxxxxxxxxxxxxxxx>>
Cc: calle.hedberg@xxxxxxxxx<mailto:calle.hedberg@xxxxxxxxx>; DHIS 2 Users list <dhis2-users@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-users@xxxxxxxxxxxxxxxxxxx>>; Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx<mailto:georgi@xxxxxxxxxxxxxxxxxxx>>; dhis2-devs <dhis2-devs@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>>
Subject: Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE

Hi Kris,

I haven’t looked at your .csv file, but from your screenshot it is clear DHIS2 is not recognising it as a .csv file type. If it were, you would see an extra menu appear and be able to select the object type you are attempting to create (see my screenshot). This is not visible in your screenshot.

<image001.png>

Some things to check:
Has your template strictly followed the csv template layout in the documentation? https://docs.dhis2.org/2.30/en/developer/html/webapi_csv_metadata_import.html#webapi_csv_org_units
Is your .csv format the correct .csv format for DHIS2? (Some .csv in francophone countries struggle as they use semi-colon)

Hopefully something there is helpful. If not, it may be a bug but let’s test those things first.
It is also worth checking whether your import strategies are doing what you expect. The default on the new system is different to the old. Strategies are also found in the documentation - section 1.11

All best,
Blake


--


<image002.png>
Blake Hansen
Projects Implementation Manager, BAO Systems
+1 202-536-1541 | bhansen@xxxxxxxxxxxxxx<mailto:bhansen@xxxxxxxxxxxxxx> | http://www.baosystems.com<http://www.baosystems.com/> |
Skype: blake.a.hansen | 2900 K Street, Suite 507, Washington D.C. 20007

Register for the 2019 DHIS 2 Symposium:

<image003.png><https://dhis2symposium.org/>

On 1 Nov 2018, at 17:09, Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx<mailto:Kristiyan@xxxxxxxxxxxxxxxxxxx>> wrote:

Hi Calle,

Thanks for looking into the .csv
I tried your suggestions and still NO import. I added short names, codes, opening date – import error hasn’t changed.

Kris

From: Calle Hedberg [mailto:calle.hedberg@xxxxxxxxx]
Sent: Thursday, November 1, 2018 6:07 PM
To: Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx<mailto:Kristiyan@xxxxxxxxxxxxxxxxxxx>>
Cc: bhansen@xxxxxxxxxxxxxx<mailto:bhansen@xxxxxxxxxxxxxx>; DHIS 2 Users list <dhis2-users@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-users@xxxxxxxxxxxxxxxxxxx>>; Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx<mailto:georgi@xxxxxxxxxxxxxxxxxxx>>; dhis2-devs <dhis2-devs@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>>
Subject: Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE

Hi,

Your csv file might not import because at least two compulsory fields are blank:
- Shortname is compulsory (missing)
- Openingdate is compulsory (missing)

I have not tried to import orgunits with those fields missing for a looong time, but while i seem to recall a missing openingdate would be replaced by the default date 1970-01-01, I don't think the same happens for shortnames (note; I could be wrong).

in any case, it's a bad habit to import orgunits with such key fields blank (for instance, it's unlikely that opening dates from 1970 is anywhere near the correct openingdates).

Regards
Calle

On Thu, 1 Nov 2018 at 16:43, Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx<mailto:Kristiyan@xxxxxxxxxxxxxxxxxxx>> wrote:
Dear Blake,

Thank you for approaching our issue.

I am afraid that the solution to the problem is not that simple. DHIS2 still doesn’t recognize the Org Unit csv file, although that is a structure that has been successfully imported in previous versions. I also got the parent UID from DHIS2 directly. I have attached the csv in this email, if you want to take a look.

I also send you the screenshot from the failed import (below).

Thanks,
Kris


[cid:image003.jpg@01D4720A.4BE07E30]





From: Blake Hansen [mailto:bhansen@xxxxxxxxxxxxxx<mailto:bhansen@xxxxxxxxxxxxxx>]
Sent: Thursday, November 1, 2018 4:23 PM
To: Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx<mailto:Kristiyan@xxxxxxxxxxxxxxxxxxx>>
Cc: dhis2-devs@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>; dhis2-users@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-users@xxxxxxxxxxxxxxxxxxx>; Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx<mailto:georgi@xxxxxxxxxxxxxxxxxxx>>
Subject: Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE

Hi Kristiyan,

DHIS2 still support this in 2.30, which you will see in the documentation. The only difference is that you no longer have to select the upload file type. DHIS2 automatically detects that it is a .csv file. Then you will be asked to choose the type of object you are creating.

So the first step, is click on upload file, select your .csv file, and import from there as usual.

All best,
Blake


--


[cid:image001.png@01D47207.01FA37A0]
Blake Hansen
Projects Implementation Manager, BAO Systems
+1 202-536-1541 | bhansen@xxxxxxxxxxxxxx<mailto:bhansen@xxxxxxxxxxxxxx> | http://www.baosystems.com<http://www.baosystems.com/> |
Skype: blake.a.hansen | 2900 K Street, Suite 507, Washington D.C. 20007

Register for the 2019 DHIS 2 Symposium:

[cid:image002.png@01D47207.01FA37A0]<https://dhis2symposium.org/>

On 1 Nov 2018, at 11:24, Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx<mailto:Kristiyan@xxxxxxxxxxxxxxxxxxx>> wrote:

Dear DHIS2 experts,

I am writing to you because I have the following issue with DHIS2 METADATA IMPORT:

I want to import (first) Organizational units and unfortunately I do not see the .csv import and object type in the IMPORT/EXPORT APP.

I see the DHIS2 2.30 guide on importing metadata has this functionalities (see below SCREENSHOT 1) that are not present in our DHIS2 instance (see below SCREENSHOT 2)


My questions, therefore is: How can I import Org Units (and other metadata) from a .csv format in DHIS2?


Reards,
Kris


________________________________________________________________________________
SCREENSHOT 1
<image002.jpg>




SCREENSHOT 2


<image004.jpg>


_______________________________________________
Mailing list: https://launchpad.net/~dhis2-devs
Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-devs
Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


--
*******************************************
Calle Hedberg
46D Alma Road, 7700 Rosebank, SOUTH AFRICA
Tel/fax (home): +27-21-685-6472
Cell: +27-82-853-5352
Iridium SatPhone: +8816-315-19119
Email: calle.hedberg@xxxxxxxxx<mailto:calle.hedberg@xxxxxxxxx>
Skype: calle_hedberg
*******************************************

_______________________________________________
Mailing list: https://launchpad.net/~dhis2-devs
Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp
_______________________________________________
Mailing list: https://launchpad.net/~dhis2-devs
Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx<mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp


--

Viet Nguyen
Software Developer, DHIS 2
University of Oslo
http://www.dhis2.org<http://www.dhis2.org/>



Follow ups

References