← Back to team overview

dhis2-devs team mailing list archive

Re: Large organisation unit import issue

 

Hi Nicolas,

Hard to say without a stack trace.  It just bombs with no explanation?

Could you consider using direct SQL injection for such a large number of
orgunits?

Regards,
Jason

On Thu, Oct 22, 2015, 18:14 Nicolas Germeau <ngermeau@xxxxxxxxxxxxxx> wrote:

> Hello,
>
> I'm trying to make a rather large import of orgunit. The size of the file
> is around 8megs zipped and it contains more than 37000 orgunits.
>
> When I'm launching the import it takes a little bit more than an hour. I
> can see in the log file (dhis.log) outputs telling me that org unit are
> being imported.  At the end I'm receiving the following message in
> catalina.out
>
> * INFO  2015-10-22 15:26:50,878 [Level: INFO, category: METADATA_IMPORT,
> time: Thu Oct 22 15:26:50 GMT 2015, message: Import done. Completed in
> 4171.72 seconds.] (InMemoryNotifier.java [taskScheduler-1])
>
> and then the server crash without any message on what when wrong. Nothing
> is imported.
>
> I'm wondering how the import works, can I split the file arbitrary in
> multiple smaller parts (will it handle the fk parent id correctly) ? Or do
> I have to split the file per level to ensure parent finding ?
>
> Thanks
> Regards
> Nicolas
>
>
> --
> *Nicolas Germeau*
> *Software Developer*
>
> GSM:  +32 487 129820
>
> Tel: +32 2 737 65 16
> Skype: nicolas.germeau
>
> Follow us on Twitter <https://twitter.com/bluesquare_org>
> Join us on Facebook <https://www.facebook.com/BlueSquare.org?fref=ts>
> Visit our new website <http://www.bluesquare.org/>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to     : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help   : https://help.launchpad.net/ListHelp
>

Follow ups

References