dhis2-devs team mailing list archive

[Paulo Grácio <pgracio@xxxxxxxxxxxxxxxxxxxx>]

Hi all,

 

Please find my comments below. 

 

Regards,

Paulo Grácio

 

From: Pascal Brandt [mailto:pascal@xxxxxxxxx] 
Sent: terça-feira, 6 de Agosto de 2013 14:56
To: Paulo Grácio
Cc: Jason Pickering; DHIS 2 developers; Chris Seebregts; Carl Fourie; Ryan
Crichton
Subject: Re: [Dhis2-devs] Interoperability question

 

Hi all,

 

This thread is important for at least two separate projects that Jembi is
working on.

 

What we're looking for is a way to automatically import data into the DHIS.
It's not a once-off import, but it's also not transactional (DHIS2 forms
aren't being completed on a regular basis). For a once-off, we could use CSV
or DXF or one of the other options via the web interface and for
transactional we could use the Web API. 

What would be the recommended way to do this periodic bulk data load? I see
the following options:

1.	Sending data values using SDMX-HD
<http://www.dhis2.org/doc/snapshot/en/user/html/ch25s08.html> 
2.	Sending large bulks of data values
<http://www.dhis2.org/doc/snapshot/en/user/html/ch25s09.html> 
3.	Integration Engine
<http://www.dhis2.org/doc/snapshot/en/user/html/ch26.html> 

[Paulo Grácio] IMHO option 1 is definitely the most appropriated. To have it
automatically loaded into DHIS2 the best solution might be to implement an
adapter that translates data to SDMX-HD before send it to DHIS2. Using this
approach you also isolate your application specific data format from other
systems, communication is always done using standard format.     

The main point is that needs to be automatic (no user interaction with the
UI) and we need to be able to initiate the process on an ad-hoc bases. Is
there a way to load CSV or DXF using the Web API? 

[Paulo Grácio] Please have a look at section 25.6. Sending data values of
DHIS2 User Manual.

 <http://apps.dhis2.org/demo/api/dataValueSets>
http://apps.dhis2.org/demo/api/dataValueSets

 

Also, I'm having some trouble finding the documentation for the DXF format,
is it available somewhere?

[Paulo Grácio] By Morten Olav Hansen “This one is difficult, but we will try
and provide something. Our api is very much a moving target though, ane
because of some design choices we cannot just generate this.”

 <https://bugs.launchpad.net/dhis2/+bug/990783>
https://bugs.launchpad.net/dhis2/+bug/990783

 

Thanks for your help.

 

Regards,

Pascal

 

 

On 1 August 2013 18:50, Paulo Grácio <pgracio@xxxxxxxxxxxxxxxxxxxx> wrote:

Hi Jason,

 

Basically what we are trying to achieved is a way to simple export data from
a legacy system into dhis2.  Once this system only generates excel files as
output we would like to import the generated file directly(without
modifications) to DHIS2 and have an import summary. 

 

We know that we can do it using several different approaches and we are
considering them J.

 

Regards,

Paulo Grácio

 

From: Jason Pickering [mailto:jason.p.pickering@xxxxxxxxx] 
Sent: quinta-feira, 1 de Agosto de 2013 13:26
To: Paulo Grácio


Cc: DHIS 2 developers
Subject: Re: [Dhis2-devs] Interoperability question

 

Hi Paulo,

I am not sure it would be worth it, but looks like it might work. Why can't
you just simply export CSV instead? Seems that given the structure of your
data, you could just simply use the CSV importer instead of setting up an
integration route?


Regards,

Jason

 

 

On Wed, Jul 31, 2013 at 7:03 PM, Paulo Grácio <pgracio@xxxxxxxxxxxxxxxxxxxx>
wrote:

Hi all,

 

We are wondering about the best form to import in DHIS2 data from legacy
applications.

 

In chapter “26.4. Transforming data - a Java route” of the User Manual we
see that there is a way to do this integration using Java routes, but we are
having some difficulties in implementing a proof of concept.

 

In our PoC scenario we have a XLS file sent by an external application
(DataValues.xls in attach). Our idea is to create a Java route in order to
import all data values that exist in that file.

 

Following the tutorial “Customer 3: Excel via e-mail” presented in the
Apache Camel page -
<http://camel.apache.org/tutorial-business-partners.html>
http://camel.apache.org/tutorial-business-partners.html - we have been able
to transform the XLS file in a list of DataValue objects. 

 

Basically, we only had to create a XLSDataIn route and a ExcelConverterBean
(files in attach). The XLSDataIn takes an InputStream of an XLS file and
calls the ExcelConverterBean. The ExcelConverterBean iterates through the
file, and for each data value row, creates a new DataValue object and adds
that object to a list of DataValue objects.

 

Now we are having some issues because we don’t know the best way to insert
these data values in DHIS2.

 

The questions we are having are:

1.       The approach that we have used to implement our PoC is the correct
one? I mean, XLS -> List<DataValue> -> import is correct or we should use
XLS -> CSV -> import?

2.       How should we proceed, after the XLS file has been processed by the
ExcelConverterBean?

 

 

Thanks for your support,

 <mailto:*%20your-email%20*> Paulo Grácio
Technical Manager
Skype: paulojrgracio

 <http://www.criticalsoftware.co.uk/> Critical Software Mozambique
Dependable Technologies for Critical Systems

Critical Software Mozambique is a subsidiary of  <http://cmmiinstitute.com/>
Critical Software, a CMMI® Level 5 rated Company
CMMI® is registered in the USPTO by  <http://www.cmu.edu/> CMU

Rua Pereira Marinho, 179
Bairro de Sommerchield
Maputo
Moçambique
Phone: (+258) 214 951 45 <tel:%28%2B258%29%20214%20951%2045> 
Fax: (+258) 214 951 46 <tel:%28%2B258%29%20214%20951%2046> 

DISCLAIMER: This message is confidential and may contain privileged
information. It is for use only by the people or entities to whom it is
addressed. If you are not an intended recipient, you should not disclose,
distribute, copy, print, rely on or otherwise make use of this message. If
an addressing or transmission error has misdirected it to you we would be
grateful if you would please notify the sender by return, before deleting it
from your system.

 

 


_______________________________________________
Mailing list: https://launchpad.net/~dhis2-devs
Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp

 


_______________________________________________
Mailing list: https://launchpad.net/~dhis2-devs
Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~dhis2-devs
More help   : https://help.launchpad.net/ListHelp





 

-- 
Pascal Brandt
Senior Software Developer, Jembi Health Systems |  SOUTH AFRICA
Mobile: +27 84 827 9342 | Office: +27 21 701 0939 | Skype: psbrandt
E-mail: pascal@xxxxxxxxx