dhis2-devs team mailing list archive

[Pascal Brandt <pascal@xxxxxxxxx>]

Hi all,

This thread is important for at least two separate projects that Jembi is
working on.

What we're looking for is a way to automatically import data into the DHIS.
It's not a once-off import, but it's also not transactional (DHIS2 forms
aren't being completed on a regular basis). For a once-off, we could use
CSV or DXF or one of the other options via the web interface and for
transactional we could use the Web API.

What would be the recommended way to do this periodic bulk data load? I see
the following options:

   1. Sending data values using
SDMX-HD<http://www.dhis2.org/doc/snapshot/en/user/html/ch25s08.html>
   2. Sending large bulks of data
values<http://www.dhis2.org/doc/snapshot/en/user/html/ch25s09.html>
   3. Integration
Engine<http://www.dhis2.org/doc/snapshot/en/user/html/ch26.html>

The main point is that needs to be automatic (no user interaction with the
UI) and we need to be able to initiate the process on an ad-hoc bases. Is
there a way to load CSV or DXF using the Web API? Also, I'm having some
trouble finding the documentation for the DXF format, is it available
somewhere?

Thanks for your help.

Regards,
Pascal



On 1 August 2013 18:50, Paulo Grácio <pgracio@xxxxxxxxxxxxxxxxxxxx> wrote:

> Hi Jason,****
>
> ** **
>
> Basically what we are trying to achieved is a way to simple export data
> from a legacy system into dhis2.  Once this system only generates excel
> files as output we would like to import the generated file directly(without
> modifications) to DHIS2 and have an import summary. ****
>
> ** **
>
> We know that we can do it using several different approaches and we are
> considering them J.****
>
> ** **
>
> Regards,****
>
> Paulo Grácio****
>
> ** **
>
> *From:* Jason Pickering [mailto:jason.p.pickering@xxxxxxxxx]
> *Sent:* quinta-feira, 1 de Agosto de 2013 13:26
> *To:* Paulo Grácio
>
> *Cc:* DHIS 2 developers
> *Subject:* Re: [Dhis2-devs] Interoperability question****
>
> ** **
>
> Hi Paulo,****
>
> I am not sure it would be worth it, but looks like it might work. Why
> can't you just simply export CSV instead? Seems that given the structure of
> your data, you could just simply use the CSV importer instead of setting up
> an integration route?****
>
>
> Regards,****
>
> Jason****
>
> ** **
>
> ** **
>
> On Wed, Jul 31, 2013 at 7:03 PM, Paulo Grácio <
> pgracio@xxxxxxxxxxxxxxxxxxxx> wrote:****
>
> Hi all,****
>
>  ****
>
> We are wondering about the best form to import in DHIS2 data from legacy
> applications.****
>
>  ****
>
> In chapter “26.4. Transforming data - a Java route” of the User Manual we
> see that there is a way to do this integration using Java routes, but we
> are having some difficulties in implementing a proof of concept.****
>
>  ****
>
> In our PoC scenario we have a XLS file sent by an external application
> (DataValues.xls in attach). Our idea is to create a Java route in order to
> import all data values that exist in that file.****
>
>  ****
>
> Following the tutorial “Customer 3: Excel via e-mail” presented in the
> Apache Camel page -
> http://camel.apache.org/tutorial-business-partners.html - we have been
> able to transform the XLS file in a list of DataValue objects. ****
>
>  ****
>
> Basically, we only had to create a XLSDataIn route and a
> ExcelConverterBean (files in attach). The XLSDataIn takes an InputStream of
> an XLS file and calls the ExcelConverterBean. The ExcelConverterBean
> iterates through the file, and for each data value row, creates a new
> DataValue object and adds that object to a list of DataValue objects.****
>
>  ****
>
> Now we are having some issues because we don’t know the best way to insert
> these data values in DHIS2.****
>
>  ****
>
> The questions we are having are:****
>
> 1.       The approach that we have used to implement our PoC is the
> correct one? I mean, XLS -> List<DataValue> -> import is correct or we
> should use XLS -> CSV -> import?****
>
> 2.       How should we proceed, after the XLS file has been processed by
> the ExcelConverterBean?****
>
>  ****
>
>  ****
>
> Thanks for your support,****
>
> *Paulo Grácio <*%20your-email%20*>*
> *Technical Manager*
> Skype: paulojrgracio****
>
> *Critical Software Mozambique* <http://www.criticalsoftware.co.uk/>
> *Dependable Technologies for Critical Systems*****
>
> Critical Software Mozambique is a subsidiary of Critical Software, a
> CMMI® Level 5 rated Company <http://cmmiinstitute.com/>
> CMMI® is registered in the USPTO by CMU <http://www.cmu.edu/>****
>
> Rua Pereira Marinho, 179
> Bairro de Sommerchield
> Maputo
> Moçambique
> Phone: (+258) 214 951 45
> Fax: (+258) 214 951 46****
>
> DISCLAIMER: This message is confidential and may contain privileged
> information. It is for use only by the people or entities to whom it is
> addressed. If you are not an intended recipient, you should not disclose,
> distribute, copy, print, rely on or otherwise make use of this message. If
> an addressing or transmission error has misdirected it to you we would be
> grateful if you would please notify the sender by return, before deleting
> it from your system.****
>
>  ****
>
>  ****
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp****
>
> ** **
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp
>
>


-- 
*Pascal Brandt
Senio**r Software Developer, Jembi Health Systems |  SOUTH AFRICA
Mobile: +27 84 827 9342 | Office: +27 21 701 0939 | Skype: psbrandt
E-mail: pascal@xxxxxxxxx*