dhis2-devs team mailing list archive

[Muhammad Adeel <adeel@xxxxxxxxx>]

Hi Kristiyan,

Support for conflicts and ignored count added to Task Summaries.

When you import for example below, a subset of your data you get conflicts
reports as below.

[image: 1.data-import.png]


[image: 2.data-import.png]

On Tue, Nov 6, 2018 at 1:48 PM Kristiyan Panayotov <
Kristiyan@xxxxxxxxxxxxxxxxxxx> wrote:

> Thank you Adeel,
>
>
>
> Attached is my csv.  This one has been successfully uploaded in version
> 2.28.
>
>
>
> I haven’t posted this in jira because I wasn’t sure that it is a bug.
>
>
>
> Kind regards,
>
> Kris
>
>
>
> *From:* Dhis2-users [mailto:dhis2-users-bounces+kristiyan=
> logicaloutcomes.net@xxxxxxxxxxxxxxxxxxx] *On Behalf Of *Muhammad Adeel
> *Sent:* Tuesday, November 6, 2018 12:42 PM
> *To:* Viet Nguyen <viet@xxxxxxxxx>
> *Cc:* dhis2-users <dhis2-users@xxxxxxxxxxxxxxxxxxx>; dcocos@xxxxxxxxxxxxxx;
> DHIS 2 Developers list <dhis2-devs@xxxxxxxxxxxxxxxxxxx>
> *Subject:* Re: [Dhis2-users] [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>
>
>
> Hi Peter / Kris,
>
>
>
> We fixed the bug related to importing CSV (file extension) in caps.
>
> Can you guys send us the files to test so we can resolve the bugs.
> Additionally you can file bugs in jira.dhis2.org and assign me to resolve
> them.
>
>
>
> Regards,
>
> Adeel
>
>
>
> On Tue, Nov 6, 2018 at 6:38 AM Viet Nguyen <viet@xxxxxxxxx> wrote:
>
> Hi Peter,
>
>
>
> Please help to report the issues you got on jira.dhis2.org so we could
> check and fix the import/export app.
>
>
>
> Thanks,
>
>
>
> On Tue, Nov 6, 2018 at 10:24 AM Peter D Lubambi <plubambi@xxxxxxxxx>
> wrote:
>
> I think the import function in dhis2 2.30 is not working completely, can
> someone confirm otherwise? I, as well tried importing in 2.30 several times
> it never worked, had to downgrade to 2.29 then I was able to import.
>
>
>
> Peter
>
> On Mon, Nov 5, 2018, 3:09 PM Kristiyan Panayotov <
> Kristiyan@xxxxxxxxxxxxxxxxxxx wrote:
>
> Hi all – thank for your support and suggestions.
>
>
>
> We managed to find a solution to our problem. We downgraded to version
> 2.29 and found a good balance between using the new Android app together
> with import functionalities.
> For importing Org Units through a .csv file in version 2.30 – I will say
> that it was not possible after all. We tried many different combinations
> for creating the .csv files and none was successful. Together with the fact
> that some of the Org Unit csv files have been successfully imported in
> versions 2.25 – 2.29
>
>
>
> Regards and thank you all
>
> Kris
>
>
>
> *From:* Viet Nguyen [mailto:viet@xxxxxxxxx]
> *Sent:* Friday, November 2, 2018 10:24 AM
> *To:* dcocos@xxxxxxxxxxxxxx
> *Cc:* Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx>; dhis2-users <
> dhis2-users@xxxxxxxxxxxxxxxxxxx>; Kristiyan Panayotov <
> Kristiyan@xxxxxxxxxxxxxxxxxxx>; dhis2-devs <dhis2-devs@xxxxxxxxxxxxxxxxxxx
> >
> *Subject:* Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>
>
>
> Hi Georgi and Kristiyan,
>
>
>
> Could you try to change the file extension from ".CSV" to lowercase and
> import again ? I think this is a bug, already reported to the app developer
> and he's fixing it.
>
>
>
> We also have added the import summary which will show all the import
> errors. It's on master and being backported to 2.30.
>
>
>
> Regards,
>
>
>
>
>
>
>
>
>
>
>
> On Fri, Nov 2, 2018 at 5:04 AM Dan Cocos <dcocos@xxxxxxxxxxxxxx> wrote:
>
> Is it encoded as UTF-8? I noticed as few “special” charters and that might
> cause problems.
>
>
>
> Dan Cocos
>
> *BAO Systems*
>
> On Nov 1, 2018, at 5:33 PM, Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx>
> wrote:
>
> Hi Blake,
>
>
>
> Thanks for your response!
>
>
>
> I am a colleague of Kristiyan. We use csv format as we have always used
> for DHIS2 versions 2.28 and below.
>
> So it seems that DHIS2 changed standards for csv for some reason. The
> exact same csv that Kris sent you was used to import org units in 2.28
> instance and now is not recognized. We compared the template layout in 2.30
> and it matches a 100% our file. I have also tried a csv export software
> with different options of csv files with no luck.
>
>
>
> Maybe you could advice on how you generate csv files?
>
>
>
> Regards,
>
> Georgi
>
>
>
> *From:* Blake Hansen <bhansen@xxxxxxxxxxxxxx>
> *Sent:* Thursday, November 1, 2018 7:17 PM
> *To:* Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx>
> *Cc:* calle.hedberg@xxxxxxxxx; DHIS 2 Users list <
> dhis2-users@xxxxxxxxxxxxxxxxxxx>; Georgi Chakarov <
> georgi@xxxxxxxxxxxxxxxxxxx>; dhis2-devs <dhis2-devs@xxxxxxxxxxxxxxxxxxx>
> *Subject:* Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>
>
>
> Hi Kris,
>
>
>
> I haven’t looked at your .csv file, but from your screenshot it is clear
> DHIS2 is not recognising it as a .csv file type. If it were, you would see
> an extra menu appear and be able to select the object type you are
> attempting to create (see my screenshot). This is not visible in your
> screenshot.
>
>
>
> <image001.png>
>
>
>
> Some things to check:
>
> Has your template *strictly *followed the csv template layout in the
> documentation?
> https://docs.dhis2.org/2.30/en/developer/html/webapi_csv_metadata_import.html#webapi_csv_org_units
>
> Is your .csv format the correct .csv format for DHIS2? (Some .csv in
> francophone countries struggle as they use semi-colon)
>
>
>
> Hopefully something there is helpful. If not, it may be a bug but let’s
> test those things first.
>
> It is also worth checking whether your import strategies are doing what
> you expect. The default on the new system is different to the old.
> Strategies are also found in the documentation - section 1.11
>
>
>
> All best,
>
> Blake
>
>
>
>
>
> --
>
>
>
>
> <image002.png>
>
> *Blake Hansen*
> Projects Implementation Manager, BAO Systems
>
> +1 202-536-1541 | bhansen@xxxxxxxxxxxxxx | http://www.baosystems.com |
>
> Skype: blake.a.hansen | 2900 K Street, Suite 507, Washington D.C. 20007
>
>
>
> Register for the 2019 DHIS 2 Symposium:
>
>
> <image003.png> <https://dhis2symposium.org/>
>
>
>
> On 1 Nov 2018, at 17:09, Kristiyan Panayotov <
> Kristiyan@xxxxxxxxxxxxxxxxxxx> wrote:
>
>
>
> Hi Calle,
>
>
>
> Thanks for looking into the .csv
>
> I tried your suggestions and still NO import. I added short names, codes,
> opening date – import error hasn’t changed.
>
>
>
> Kris
>
>
>
> *From:* Calle Hedberg [mailto:calle.hedberg@xxxxxxxxx
> <calle.hedberg@xxxxxxxxx>]
> *Sent:* Thursday, November 1, 2018 6:07 PM
> *To:* Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx>
> *Cc:* bhansen@xxxxxxxxxxxxxx; DHIS 2 Users list <
> dhis2-users@xxxxxxxxxxxxxxxxxxx>; Georgi Chakarov <
> georgi@xxxxxxxxxxxxxxxxxxx>; dhis2-devs <dhis2-devs@xxxxxxxxxxxxxxxxxxx>
> *Subject:* Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>
>
>
> Hi,
>
>
>
> Your csv file might not import because at least two compulsory fields are
> blank:
>
> - Shortname is compulsory (missing)
>
> - Openingdate is compulsory (missing)
>
>
>
> I have not tried to import orgunits with those fields missing for a looong
> time, but while i seem to recall a missing openingdate would be replaced by
> the default date 1970-01-01, I don't think the same happens for shortnames
> (note; I could be wrong).
>
>
>
> in any case, it's a bad habit to import orgunits with such key fields
> blank (for instance, it's unlikely that opening dates from 1970 is anywhere
> near the correct openingdates).
>
>
>
> Regards
>
> Calle
>
>
>
> On Thu, 1 Nov 2018 at 16:43, Kristiyan Panayotov <
> Kristiyan@xxxxxxxxxxxxxxxxxxx> wrote:
>
> Dear Blake,
>
>
>
> Thank you for approaching our issue.
>
>
>
> I am afraid that the solution to the problem is not that simple. DHIS2
> still doesn’t recognize the Org Unit csv file, although that is a structure
> that has been successfully imported in previous versions. I also got the
> parent UID from DHIS2 directly. I have attached the csv in this email, if
> you want to take a look.
>
>
>
> I also send you the screenshot from the failed import (below).
>
>
>
> Thanks,
>
> Kris
>
>
>
>
>
>
>
>
>
>
>
>
>
>
>
> *From:* Blake Hansen [mailto:bhansen@xxxxxxxxxxxxxx]
> *Sent:* Thursday, November 1, 2018 4:23 PM
> *To:* Kristiyan Panayotov <Kristiyan@xxxxxxxxxxxxxxxxxxx>
> *Cc:* dhis2-devs@xxxxxxxxxxxxxxxxxxx; dhis2-users@xxxxxxxxxxxxxxxxxxx;
> Georgi Chakarov <georgi@xxxxxxxxxxxxxxxxxxx>
> *Subject:* Re: [Dhis2-devs] DHIS2 2.30 IMPORT/EXPORT ISSUE
>
>
>
> Hi Kristiyan,
>
>
>
> DHIS2 still support this in 2.30, which you will see in the documentation.
> The only difference is that you no longer have to select the upload file
> type. DHIS2 automatically detects that it is a .csv file. Then you will be
> asked to choose the type of object you are creating.
>
>
>
> So the first step, is click on upload file, select your .csv file, and
> import from there as usual.
>
>
>
> All best,
>
> Blake
>
>
>
>
>
> --
>
>
>
>
> *Blake Hansen*
> Projects Implementation Manager, BAO Systems
>
> +1 202-536-1541 | bhansen@xxxxxxxxxxxxxx | http://www.baosystems.com |
>
> Skype: blake.a.hansen | 2900 K Street, Suite 507, Washington D.C. 20007
>
>
>
> Register for the 2019 DHIS 2 Symposium:
>
>
> <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> On 1 Nov 2018, at 11:24, Kristiyan Panayotov <
> *Kristiyan@xxxxxxxxxxxxxxxxxxx*> wrote: <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> Dear DHIS2 experts, <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> I am writing to you because I have the following issue with DHIS2 METADATA
> IMPORT: <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> I want to import (first) Organizational units and unfortunately I do not
> see the .csv import and object type in the IMPORT/EXPORT APP.
> <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> I see the DHIS2 2.30 guide on importing metadata has this functionalities
> (see below SCREENSHOT 1) that are not present in our DHIS2 instance (see
> below SCREENSHOT 2) <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> My questions, therefore is: How can I import Org Units (and other
> metadata) from a .csv format in DHIS2? <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> Reards, <https://dhis2symposium.org/>
>
> Kris <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>
> ________________________________________________________________________________
> <https://dhis2symposium.org/>
>
> SCREENSHOT 1 <https://dhis2symposium.org/>
>
> <image002.jpg> <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> SCREENSHOT 2 <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> <image004.jpg> <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> _______________________________________________
> Mailing list: *https://launchpad.net/~dhis2-devs*
> Post to     : *dhis2-devs@xxxxxxxxxxxxxxxxxxx*
> Unsubscribe : *https://launchpad.net/~dhis2-devs*
> More help   : *https://help.launchpad.net/ListHelp*
> <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> _______________________________________________
> Mailing list: *https://launchpad.net/~dhis2-devs*
> Post to     : *dhis2-devs@xxxxxxxxxxxxxxxxxxx*
> Unsubscribe : *https://launchpad.net/~dhis2-devs*
> More help   : *https://help.launchpad.net/ListHelp*
> <https://dhis2symposium.org/>
>
>
> <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> --  <https://dhis2symposium.org/>
>
> ******************************************* <https://dhis2symposium.org/>
>
> Calle Hedberg <https://dhis2symposium.org/>
>
> 46D Alma Road, 7700 Rosebank, SOUTH AFRICA  <https://dhis2symposium.org/>
>
> Tel/fax (home): +27-21-685-6472 <https://dhis2symposium.org/>
>
> Cell: +27-82-853-5352 <https://dhis2symposium.org/>
>
> Iridium SatPhone: +8816-315-19119 <https://dhis2symposium.org/>
>
> Email: *calle.hedberg@xxxxxxxxx* <https://dhis2symposium.org/>
>
> Skype: calle_hedberg <https://dhis2symposium.org/>
>
> ******************************************* <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> _______________________________________________
> Mailing list: *https://launchpad.net/~dhis2-devs*
> Post to     : *dhis2-devs@xxxxxxxxxxxxxxxxxxx*
> Unsubscribe : *https://launchpad.net/~dhis2-devs*
> More help   : *https://help.launchpad.net/ListHelp*
> <https://dhis2symposium.org/>
>
> _______________________________________________
> Mailing list: *https://launchpad.net/~dhis2-devs*
> Post to     : *dhis2-devs@xxxxxxxxxxxxxxxxxxx*
> Unsubscribe : *https://launchpad.net/~dhis2-devs*
> More help   : *https://help.launchpad.net/ListHelp*
> <https://dhis2symposium.org/>
>
>
> <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> -- <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> Viet Nguyen <https://dhis2symposium.org/>
>
> Software Developer, DHIS 2 <https://dhis2symposium.org/>
>
> University of Oslo <https://dhis2symposium.org/>
>
> *http://www.dhis2.org* <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> _______________________________________________
> Mailing list: *https://launchpad.net/~dhis2-users*
> Post to     : *dhis2-users@xxxxxxxxxxxxxxxxxxx*
> Unsubscribe : *https://launchpad.net/~dhis2-users*
> More help   : *https://help.launchpad.net/ListHelp*
> <https://dhis2symposium.org/>
>
>
> <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> -- <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> Viet Nguyen <https://dhis2symposium.org/>
>
> Software Developer, DHIS 2 <https://dhis2symposium.org/>
>
> University of Oslo <https://dhis2symposium.org/>
>
> *http://www.dhis2.org* <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
>   <https://dhis2symposium.org/>
>
> _______________________________________________
> Mailing list: *https://launchpad.net/~dhis2-users*
> Post to     : *dhis2-users@xxxxxxxxxxxxxxxxxxx*
> Unsubscribe : *https://launchpad.net/~dhis2-users*
> More help   : *https://help.launchpad.net/ListHelp*
> <https://dhis2symposium.org/>
>
>

Name,UID,Code,Parent UID,Short name,Description,Opening date,Closed date,Comment,Feature type,Coordinates,URL,Contact person,Address,Email,Phone number
Kayes (Region),ceb0SkzyHZd,Kayes (Region),A7s2zp62VR6,Kayes (Region),Region,,,,,,,,,,