← Back to team overview

dhis2-devs team mailing list archive

Re: [Dhis2-users] DHIS2 2.30 IMPORT/EXPORT ISSUE

 

Hi Peter / Kris,

We fixed the bug related to importing CSV (file extension) in caps.
Can you guys send us the files to test so we can resolve the bugs.
Additionally you can file bugs in jira.dhis2.org and assign me to resolve
them.

Regards,
Adeel

On Tue, Nov 6, 2018 at 6:38 AM Viet Nguyen <viet@xxxxxxxxx> wrote:

> Hi Peter,
>
> Please help to report the issues you got on jira.dhis2.org so we could
> check and fix the import/export app.
>
> Thanks,
>
> On Tue, Nov 6, 2018 at 10:24 AM Peter D Lubambi <plubambi@xxxxxxxxx>
> wrote:
>
>> I think the import function in dhis2 2.30 is not working completely, can
>> someone confirm otherwise? I, as well tried importing in 2.30 several times
>> it never worked, had to downgrade to 2.29 then I was able to import.
>>
>> Peter
>>
>> On Mon, Nov 5, 2018, 3:09 PM Kristiyan Panayotov <
>> Kristiyan@xxxxxxxxxxxxxxxxxxx wrote:
>>
>>> Hi all – thank for your support and suggestions.
>>>
>>>
>>>
>>> We managed to find a solution to our problem. We downgraded to version
>>> 2.29 and found a good balance between using the new Android app together
>>> with import functionalities.
>>> For importing Org Units through a .csv file in version 2.30 – I will say
>>> that it was not possible after all. We tried many different combinations
>>> for creating the .csv files and none was successful. Together with the fact
>>> that some of the Org Unit csv files have been successfully imported in
>>> versions 2.25 – 2.29
>>>
>>>
>>>
>>> Regards and thank you all
>>>
>>> Kris
>>>
>>>
>>>
>>> *From:* Viet Nguyen [mailto:viet@xxxxxxxxx]
>>> *Sent:* Friday, November 2, 2018 10:24 AM
>>> *To:* dcocos@xxxxxxxxxxxxxx
>>> *Cc:* Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx>; dhis2-users <
>>> dhis2-users@xxxxxxxxxxxxxxxxxxx>; Kristiyan Panayotov <
>>> Kristiyan@xxxxxxxxxxxxxxxxxxx>; dhis2-devs <
>>> dhis2-devs@xxxxxxxxxxxxxxxxxxx>
>>> *Subject:* Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>>>
>>>
>>>
>>> Hi Georgi and Kristiyan,
>>>
>>>
>>>
>>> Could you try to change the file extension from ".CSV" to lowercase and
>>> import again ? I think this is a bug, already reported to the app developer
>>> and he's fixing it.
>>>
>>>
>>>
>>> We also have added the import summary which will show all the import
>>> errors. It's on master and being backported to 2.30.
>>>
>>>
>>>
>>> Regards,
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> On Fri, Nov 2, 2018 at 5:04 AM Dan Cocos <dcocos@xxxxxxxxxxxxxx> wrote:
>>>
>>> Is it encoded as UTF-8? I noticed as few “special” charters and that
>>> might cause problems.
>>>
>>>
>>>
>>> Dan Cocos
>>>
>>> *BAO Systems*
>>>
>>> On Nov 1, 2018, at 5:33 PM, Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx>
>>> wrote:
>>>
>>> Hi Blake,
>>>
>>>
>>>
>>> Thanks for your response!
>>>
>>>
>>>
>>> I am a colleague of Kristiyan. We use csv format as we have always used
>>> for DHIS2 versions 2.28 and below.
>>>
>>> So it seems that DHIS2 changed standards for csv for some reason. The
>>> exact same csv that Kris sent you was used to import org units in 2.28
>>> instance and now is not recognized. We compared the template layout in 2.30
>>> and it matches a 100% our file. I have also tried a csv export software
>>> with different options of csv files with no luck.
>>>
>>>
>>>
>>> Maybe you could advice on how you generate csv files?
>>>
>>>
>>>
>>> Regards,
>>>
>>> Georgi
>>>
>>>
>>>
>>> *From:* Blake Hansen <bhansen@xxxxxxxxxxxxxx>
>>> *Sent:* Thursday, November 1, 2018 7:17 PM
>>> *To:* Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx>
>>> *Cc:* calle.hedberg@xxxxxxxxx; DHIS 2 Users list <
>>> dhis2-users@xxxxxxxxxxxxxxxxxxx>; Georgi Chakarov <
>>> georgi@xxxxxxxxxxxxxxxxxxx>; dhis2-devs <dhis2-devs@xxxxxxxxxxxxxxxxxxx>
>>> *Subject:* Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>>>
>>>
>>>
>>> Hi Kris,
>>>
>>>
>>>
>>> I haven’t looked at your .csv file, but from your screenshot it is clear
>>> DHIS2 is not recognising it as a .csv file type. If it were, you would see
>>> an extra menu appear and be able to select the object type you are
>>> attempting to create (see my screenshot). This is not visible in your
>>> screenshot.
>>>
>>>
>>>
>>> <image001.png>
>>>
>>>
>>>
>>> Some things to check:
>>>
>>> Has your template *strictly *followed the csv template layout in the
>>> documentation?
>>> https://docs.dhis2.org/2.30/en/developer/html/webapi_csv_metadata_import.html#webapi_csv_org_units
>>>
>>> Is your .csv format the correct .csv format for DHIS2? (Some .csv in
>>> francophone countries struggle as they use semi-colon)
>>>
>>>
>>>
>>> Hopefully something there is helpful. If not, it may be a bug but let’s
>>> test those things first.
>>>
>>> It is also worth checking whether your import strategies are doing what
>>> you expect. The default on the new system is different to the old.
>>> Strategies are also found in the documentation - section 1.11
>>>
>>>
>>>
>>> All best,
>>>
>>> Blake
>>>
>>>
>>>
>>>
>>>
>>> --
>>>
>>>
>>>
>>>
>>> <image002.png>
>>>
>>> *Blake Hansen*
>>> Projects Implementation Manager, BAO Systems
>>>
>>> +1 202-536-1541 | bhansen@xxxxxxxxxxxxxx | http://www.baosystems.com |
>>>
>>> Skype: blake.a.hansen | 2900 K Street, Suite 507, Washington D.C. 20007
>>>
>>>
>>>
>>> Register for the 2019 DHIS 2 Symposium:
>>>
>>>
>>> <image003.png> <https://dhis2symposium.org/>
>>>
>>>
>>>
>>> On 1 Nov 2018, at 17:09, Kristiyan Panayotov <
>>> Kristiyan@xxxxxxxxxxxxxxxxxxx> wrote:
>>>
>>>
>>>
>>> Hi Calle,
>>>
>>>
>>>
>>> Thanks for looking into the .csv
>>>
>>> I tried your suggestions and still NO import. I added short names,
>>> codes, opening date – import error hasn’t changed.
>>>
>>>
>>>
>>> Kris
>>>
>>>
>>>
>>> *From:* Calle Hedberg [mailto:calle.hedberg@xxxxxxxxx
>>> <calle.hedberg@xxxxxxxxx>]
>>> *Sent:* Thursday, November 1, 2018 6:07 PM
>>> *To:* Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx>
>>> *Cc:* bhansen@xxxxxxxxxxxxxx; DHIS 2 Users list <
>>> dhis2-users@xxxxxxxxxxxxxxxxxxx>; Georgi Chakarov <
>>> georgi@xxxxxxxxxxxxxxxxxxx>; dhis2-devs <dhis2-devs@xxxxxxxxxxxxxxxxxxx>
>>> *Subject:* Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>>>
>>>
>>>
>>> Hi,
>>>
>>>
>>>
>>> Your csv file might not import because at least two compulsory fields
>>> are blank:
>>>
>>> - Shortname is compulsory (missing)
>>>
>>> - Openingdate is compulsory (missing)
>>>
>>>
>>>
>>> I have not tried to import orgunits with those fields missing for a
>>> looong time, but while i seem to recall a missing openingdate would be
>>> replaced by the default date 1970-01-01, I don't think the same happens for
>>> shortnames (note; I could be wrong).
>>>
>>>
>>>
>>> in any case, it's a bad habit to import orgunits with such key fields
>>> blank (for instance, it's unlikely that opening dates from 1970 is anywhere
>>> near the correct openingdates).
>>>
>>>
>>>
>>> Regards
>>>
>>> Calle
>>>
>>>
>>>
>>> On Thu, 1 Nov 2018 at 16:43, Kristiyan Panayotov <
>>> Kristiyan@xxxxxxxxxxxxxxxxxxx> wrote:
>>>
>>> Dear Blake,
>>>
>>>
>>>
>>> Thank you for approaching our issue.
>>>
>>>
>>>
>>> I am afraid that the solution to the problem is not that simple. DHIS2
>>> still doesn’t recognize the Org Unit csv file, although that is a structure
>>> that has been successfully imported in previous versions. I also got the
>>> parent UID from DHIS2 directly. I have attached the csv in this email, if
>>> you want to take a look.
>>>
>>>
>>>
>>> I also send you the screenshot from the failed import (below).
>>>
>>>
>>>
>>> Thanks,
>>>
>>> Kris
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> *From:* Blake Hansen [mailto:bhansen@xxxxxxxxxxxxxx]
>>> *Sent:* Thursday, November 1, 2018 4:23 PM
>>> *To:* Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx>
>>> *Cc:* dhis2-devs@xxxxxxxxxxxxxxxxxxx; dhis2-users@xxxxxxxxxxxxxxxxxxx;
>>> Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx>
>>> *Subject:* Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>>>
>>>
>>>
>>> Hi Kristiyan,
>>>
>>>
>>>
>>> DHIS2 still support this in 2.30, which you will see in the
>>> documentation. The only difference is that you no longer have to select the
>>> upload file type. DHIS2 automatically detects that it is a .csv file. Then
>>> you will be asked to choose the type of object you are creating.
>>>
>>>
>>>
>>> So the first step, is click on upload file, select your .csv file, and
>>> import from there as usual.
>>>
>>>
>>>
>>> All best,
>>>
>>> Blake
>>>
>>>
>>>
>>>
>>>
>>> --
>>>
>>>
>>>
>>>
>>> *Blake Hansen*
>>> Projects Implementation Manager, BAO Systems
>>>
>>> +1 202-536-1541 | bhansen@xxxxxxxxxxxxxx | http://www.baosystems.com |
>>>
>>> Skype: blake.a.hansen | 2900 K Street, Suite 507, Washington D.C. 20007
>>>
>>>
>>>
>>> Register for the 2019 DHIS 2 Symposium:
>>>
>>>
>>> <https://dhis2symposium.org/>
>>>
>>>
>>>
>>> On 1 Nov 2018, at 11:24, Kristiyan Panayotov <
>>> Kristiyan@xxxxxxxxxxxxxxxxxxx> wrote:
>>>
>>>
>>>
>>> Dear DHIS2 experts,
>>>
>>>
>>>
>>> I am writing to you because I have the following issue with DHIS2
>>> METADATA IMPORT:
>>>
>>>
>>>
>>> I want to import (first) Organizational units and unfortunately I do not
>>> see the .csv import and object type in the IMPORT/EXPORT APP.
>>>
>>>
>>>
>>> I see the DHIS2 2.30 guide on importing metadata has this
>>> functionalities (see below SCREENSHOT 1) that are not present in our DHIS2
>>> instance (see below SCREENSHOT 2)
>>>
>>>
>>>
>>>
>>>
>>> My questions, therefore is: How can I import Org Units (and other
>>> metadata) from a .csv format in DHIS2?
>>>
>>>
>>>
>>>
>>>
>>> Reards,
>>>
>>> Kris
>>>
>>>
>>>
>>>
>>>
>>>
>>> ________________________________________________________________________________
>>>
>>> SCREENSHOT 1
>>>
>>> <image002.jpg>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> SCREENSHOT 2
>>>
>>>
>>>
>>>
>>>
>>> <image004.jpg>
>>>
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>>>
>>>
>>> --
>>>
>>> *******************************************
>>>
>>> Calle Hedberg
>>>
>>> 46D Alma Road, 7700 Rosebank, SOUTH AFRICA
>>>
>>> Tel/fax (home): +27-21-685-6472
>>>
>>> Cell: +27-82-853-5352
>>>
>>> Iridium SatPhone: +8816-315-19119
>>>
>>> Email: calle.hedberg@xxxxxxxxx
>>>
>>> Skype: calle_hedberg
>>>
>>> *******************************************
>>>
>>>
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>>
>>>
>>>
>>> --
>>>
>>>
>>>
>>> Viet Nguyen
>>>
>>> Software Developer, DHIS 2
>>>
>>> University of Oslo
>>>
>>> http://www.dhis2.org
>>>
>>>
>>>
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-users
>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>> More help   : https://help.launchpad.net/ListHelp
>>>
>>
>
> --
>
> Viet Nguyen
> Software Developer, DHIS 2
> University of Oslo
> http://www.dhis2.org
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-users
> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-users
> More help   : https://help.launchpad.net/ListHelp
>

Follow ups

References