← Back to team overview

dhis2-devs team mailing list archive

Re: DHIS2 and Tableau

 

Dear Rodolfo, 

As AChuong request, I have just update new ui for my connector (http://yeskone.com/Phplibrary/view/test_dhis_connector.html <http://yeskone.com/Phplibrary/view/test_dhis_connector.html>) and support get db from api report:
Go to https://play.dhis2.org/demo/dhis-web-pivot/ <https://play.dhis2.org/demo/dhis-web-pivot/> -> Create new or choose Favorites -> Choose one example -> Share -> Api link
Two link for test: 
https://play.dhis2.org/demo/api/reportTables/sdsxG90H0UB/data.json <https://play.dhis2.org/demo/api/reportTables/sdsxG90H0UB/data.json>
https://play.dhis2.org/demo/api/reportTables/tWg9OiyV7mu/data.json <https://play.dhis2.org/demo/api/reportTables/tWg9OiyV7mu/data.json>


Yours sincerely,
Nhan Cao
nhancv@xxxxxxxxxxx



> On Feb 2, 2016, at 12:35 AM, Rodolfo Melia <rmelia@xxxxxxxxxxxx> wrote:
> 
> Hi Nhan - this is great - your sample connector is working. We will look at your code and do a connector for our case, and see if we can try to work out a more universal connector, to avoid having to do one connector for each analysis that you may want to do from your DHIS server. We will report back on the results.
> 
> R
> 
> On 1 February 2016 at 12:52, Nhan Cao <nhancv@xxxxxxxxxxx <mailto:nhancv@xxxxxxxxxxx>> wrote:
> Dear A Chuong, 
> 
> If you through my source, I have provide auto basic authorization and can be resued this for auto call api or support ui for input anytime by edit ui yourself (like this: http://yeskone.com/Phplibrary/view/mbasic_au.html <http://yeskone.com/Phplibrary/view/mbasic_au.html>), it just example about connector, so I make it as fast as possible to show for every one see about how connector working and easy imagine. I had said : "Depend on design so connector is friendly or not." in previous email.
> With https://tableau.github.io/webdataconnector/Examples/jsonConnector.html <https://tableau.github.io/webdataconnector/Examples/jsonConnector.html> only works if paste direct Json response from api calling. If you paste api url, it doesn't work. It work with algorithm:
> (In source, line 143)
> // Given an object:
> //   - finds the longest array in the object
> //   - flattens each element in that array so it is a single object with many properties
> // If there is no array that is a descendent of the original object, this wraps
> // the input in a single element array.
> I can be work with almost all json response with that algorithm, but just for demo connector, it doesn't match with concrete requirement.
> 
> <Screen Shot 2016-02-01 at 6.07.28 PM.png>
> 
> <Screen Shot 2016-02-01 at 6.07.51 PM.png>
> 
> 
> 
> 
> Yours sincerely,
> Nhan Cao
> nhancv@xxxxxxxxxxx <mailto:nhancv@xxxxxxxxxxx>
> 
> 
> 
>> On Feb 1, 2016, at 5:53 PM, Thái Chương <thaichuong159@xxxxxxxxx <mailto:thaichuong159@xxxxxxxxx>> wrote:
>> 
>> Hello Nhan,
>> I read through your connector source.
>> Since you hard code for basic authentication, If you can modify to provide fields for url, username and password like the following sample connector, it will become a proper connector.
>> https://tableau.github.io/webdataconnector/Examples/jsonConnector.html <https://tableau.github.io/webdataconnector/Examples/jsonConnector.html>
>> I tried returned DHIS2 json data with this connector. It works.
>> 
>> On Mon, Feb 1, 2016 at 12:45 AM, Nhan Cao <nhancv@xxxxxxxxxxx <mailto:nhancv@xxxxxxxxxxx>> wrote:
>> 
>> Dear all, 
>> 
>> I have just follow this topic and have some opinion. I also see the Rodolfo's video, at 40s you paste direct api from dhis2, I think it's wrong event if data response match with tableau format. We need an connector (like adapter) like diagram below.
>> 
>> 
>> 
>> Dhis2 had provided web api to access resource. So, we just make connector sets, which is bridge of two platform (dhis2 and tableau). Depend on design so connector is friendly or not. 
>> 
>> About tableau format: http://onlinehelp.tableau.com/current/api/wdc/en-us/WDC/wdc_ref.htm <http://onlinehelp.tableau.com/current/api/wdc/en-us/WDC/wdc_ref.htm>
>> 
>> I have made an example connector (it get an api from dhis2 and convert to tableau format)
>> - Connector url: http:// <http://yeskone.com/Phplibrary/view/test_dhis_connector.html>yeskone.com/Phplibrary/view/test_dhis_connector.html <http://yeskone.com/Phplibrary/view/test_dhis_connector.html>
>> - Usage: Run tableau program -> More server... -> Web data connector -> Paste url above and Enter -> Press "Get example" button
>> 
>> 
>> 
>> 
>> 
>> My english is not very good, sorry if I make someone misunderstand. 
>> 
>> Yours sincerely,
>> Nhan Cao
>> nhancv@xxxxxxxxxxx <mailto:nhancv@xxxxxxxxxxx>
>> 
>> 
>> 
>>> On Jan 30, 2016, at 4:07 PM, Rodolfo Melia <rmelia@xxxxxxxxxxxx <mailto:rmelia@xxxxxxxxxxxx>> wrote:
>>> 
>>> We are probably going to develop one connector to test this. I will write back.
>>> 
>>> On Saturday, 30 January 2016, Morten Olav Hansen <mortenoh@xxxxxxxxx <mailto:mortenoh@xxxxxxxxx>> wrote:
>>> The ideal situation will be that any report_table in DHIS is ready to be consumed by tableau. Currently, tableau sees the data returned by the DHIS report_tables (see 40s video <https://www.youtube.com/watch?v=A84KZY5yUTU>), but cannot complete the connection. 
>>> 
>>> Yeah, as far as I know.. this is something being worked on, but Lars will have to give the details.. I don't think you will see tableau compatible data coming out of DHIS 2, but rather a specialised connector from their side.
>>>  
>>> The link that you sent, if I understand correctly, will allow to develop individual connections for specific report tables. So if an organization wants to connect 10 tables representing 10 data collections, we need to create 10 connectors - am I correct?
>>> 
>>> Well, yes.. it would require a XHR request for every data source you want to pull in, but that's the case anyways.. even with a specialised connector. The only way to remedy something like that would be to bundle multiple resource tables together.
>>> 
>>> --
>>> Morten
>>>  
>>> Ideally we want that the api can return data formatted is such a way that Tableau can consume it - imagine something like this:
>>> - server-url.org/api/tableau/aA5kJPtPf3p/data.json <http://server-url.org/api/tableau/aA5kJPtPf3p/data.json>
>>> 
>>> R
>>> 
>>>  <>
>>> 
>>> On 28 January 2016 at 05:14, Morten Olav Hansen <mortenoh@xxxxxxxxx <>> wrote:
>>> HI Rodolfo
>>> 
>>> Did you have a look at the example JSON connector?
>>> https://github.com/tableau/webdataconnector/blob/gh-pages/Examples/jsonConnector.html <https://github.com/tableau/webdataconnector/blob/gh-pages/Examples/jsonConnector.html>
>>> 
>>> It seems pretty simple to connect to any kind of JSON source.. as long as you understand the data you are pulling in (analytics, etc) it should be a simple task to then map it to headers, columns etc..
>>> 
>>> --
>>> Morten
>>> 
>>> On Wed, Jan 27, 2016 at 11:24 PM, Rodolfo Melia <rmelia@xxxxxxxxxxxx <>> wrote:
>>> Somehow, some organizations have used and want to continue using Tableau. I understand 2.23 will offer a new vizualization engine. That will be interesting, i will help taking them in that direccion.
>>> 
>>> 
>>> On Wednesday, 27 January 2016, Morten Olav Hansen <mortenoh@xxxxxxxxx <>> wrote:
>>> It would also be interesting to know why they want to connect to Tableau, I thought our philosophy would point us to a more open source direction? Tableau is a hyper commercial company? no?
>>> 
>>> While just a prototype, we in HISP Vietnam are also creating dashboards:
>>> http://dhis2.io <http://dhis2.io/> (esc, or click hamburger to see menu)
>>> 
>>> Tableau wanting to connect to us, should be seen both as a success.. and something to be wary about (if you care about code, and you have seen the output from a Tableau dashboard, you know how shitty it is)
>>> 
>>> --
>>> Morten
>>> 
>>> On Wed, Jan 27, 2016 at 10:21 PM, Knut Staring <knutst@xxxxxxxxx <>> wrote:
>>> Copying this to Sundeep also, since HISP India is also interested in this linkage, as are the WHO SEARO, WPRO and PAHO regional offices.
>>> 
>>> 
>>> On Wed, Jan 27, 2016 at 4:17 PM, Morten Olav Hansen <mortenoh@xxxxxxxxx <>> wrote:
>>> Ok, Lars will know more about that.. I know they have reached out to us.. Not sure if they will do the work or us, but I don't think the amount of work would be much.. at least our analytical json should be easy to read, I have already make connectors for the dashboards I have been creating for Lao and Indoensia
>>> 
>>> --
>>> Morten
>>> 
>>> On Wed, Jan 27, 2016 at 10:14 PM, Rodolfo Melia <rmelia@xxxxxxxxxxxx <>> wrote:
>>> only for the connector...
>>> 
>>>  <>
>>> On 27 January 2016 at 15:10, Morten Olav Hansen <mortenoh@xxxxxxxxx <>> wrote:
>>> Sure, are they planning to release an open source version then?
>>> 
>>> --
>>> Morten
>>> 
>>> On Wed, Jan 27, 2016 at 10:05 PM, Juan Manuel Alcantara Acosta <jmalcantara1@xxxxxxxxx <>> wrote:
>>> Nicola recently told me someone form Tableau will be attending the symposium. That could be a good opportunity to talk to them.
>>> JM
>>> 
>>> 
>>>> El 27/01/2016, a las 9:02 a.m., Rodolfo Melia <rmelia@xxxxxxxxxxxx <>> escribió:
>>>> 
>>>> Hi Knut - that's interesting. Look forward to hear more about that conversation with the Tableau foundation.
>>>> 
>>>> I think that somehow we need DHIS to expose the data in a XML/Json following Tableau conventions. 
>>>> 
>>>> Rodolfo Meliá
>>>> Principal  |  rmelia@xxxxxxxxxxxx <>
>>>> Skype: rod.melia  |   <>+44 777 576 4090  |   <>+1 708 872 7636 <tel:%2B1%20708%20872%207636>
>>>> www.knowming.com <http://www.knowming.com/>
>>>>  <>
>>>> On 27 January 2016 at 14:18, Knut Staring <knutst@xxxxxxxxx <>> wrote:
>>>> Hi Rodolfo,
>>>> 
>>>> There was an email recently about direct contact with the Tableau Foundation, who seem interested in working with us directly.
>>>> 
>>>> I think Lars will probably follow up on this when he is back from leave.
>>>> 
>>>> Knut
>>>> 
>>>> On Wed, Jan 27, 2016 at 2:45 PM, Morten Olav Hansen <mortenoh@xxxxxxxxx <>> wrote:
>>>> Hi Rodolfo
>>>> 
>>>> I don't know anything about Tableau, but maybe you would have better luck importing CSV data? its a bit more manageable than JSON (which can have any format)
>>>> 
>>>> --
>>>> Morten
>>>> 
>>>> On Wed, Jan 27, 2016 at 6:31 PM, Rodolfo Melia <rmelia@xxxxxxxxxxxx <>> wrote:
>>>> Hi everyone - the latest version of Tableau (9.1) has a new 'web connector' that allows to read html/ json sources. As you can see from the image below, I have successfully got to the point of DHIS returning data to Tableau, but I cannot get to the final step to start doing the charts in tableau.
>>>> 
>>>> Have anyone successfully connected DHIS to tableau using the new web connector in 9.X?
>>>> I have the impression that there is the need to modify the json that DHIS returns, based on Tableau specs. Have anyone tried to do that?
>>>> 
>>>> 
>>>> 
>>>> <Tableau Web Connector.png>
>>>> 
>>>> R
>>>> 
>>>>  <>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-devs <https://launchpad.net/~dhis2-devs>
>>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx <>
>>>> Unsubscribe : https://launchpad.net/~dhis2-devs <https://launchpad.net/~dhis2-devs>
>>>> More help   : https://help.launchpad.net/ListHelp <https://help.launchpad.net/ListHelp>
>>>> 
>>>> 
>>>> 
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-devs <https://launchpad.net/~dhis2-devs>
>>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx <>
>>>> Unsubscribe : https://launchpad.net/~dhis2-devs <https://launchpad.net/~dhis2-devs>
>>>> More help   : https://help.launchpad.net/ListHelp <https://help.launchpad.net/ListHelp>
>>>> 
>>>> 
>>>> 
>>>> 
>>>> -- 
>>>> Knut Staring
>>>> Dept. of Informatics, University of Oslo
>>>> Norway: +4791880522 <tel:%2B4791880522>
>>>> Skype: knutstar
>>>> http://dhis2.org <http://dhis2.org/>
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> 
>>> -- 
>>> Knut Staring
>>> Dept. of Informatics, University of Oslo
>>> Norway: +4791880522 <tel:%2B4791880522>
>>> Skype: knutstar
>>> http://dhis2.org <http://dhis2.org/>
>>> 
>>> 
>>> -- 
>>> Rodolfo Meliá
>>> Principal  |  rmelia@xxxxxxxxxxxx <>
>>> Skype: rod.melia  |   <>+44 777 576 4090  |   <>+1 708 872 7636 <tel:%2B1%20708%20872%207636>
>>> www.knowming.com <http://www.knowming.com/>
>>>  <>
>>> 
>>> 
>>> 
>>> 
>>> 
>>> -- 
>>> Rodolfo Meliá
>>> Principal  |  rmelia@xxxxxxxxxxxx <mailto:rmelia@xxxxxxxxxxxx>
>>> Skype: rod.melia  |   <>+44 777 576 4090  |   <>+1 708 872 7636 <tel:%2B1%20708%20872%207636>
>>> www.knowming.com <http://www.knowming.com/>
>>>  <>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-devs <https://launchpad.net/~dhis2-devs>
>>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx <mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>
>>> Unsubscribe : https://launchpad.net/~dhis2-devs <https://launchpad.net/~dhis2-devs>
>>> More help   : https://help.launchpad.net/ListHelp <https://help.launchpad.net/ListHelp>
>> 
>> _______________________________________________
>> Mailing list: https://launchpad.net/~dhis2-devs <https://launchpad.net/~dhis2-devs>
>> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx <mailto:dhis2-devs@xxxxxxxxxxxxxxxxxxx>
>> Unsubscribe : https://launchpad.net/~dhis2-devs <https://launchpad.net/~dhis2-devs>
>> More help   : https://help.launchpad.net/ListHelp <https://help.launchpad.net/ListHelp>
>> 
>> 
>> 
>> 
>> -- 
>> THAI Chuong
>> YM/Skype : thaichuong159
>> Phone: (+84) 918776134 <tel:%28%2B84%29%20918776134>
> 
> 


References