dhis2-users team mailing list archive
-
dhis2-users team
-
Mailing list archive
-
Message #12566
Re: [Dhis2-devs] Fwd: Import of DHIS metdata taking long time
Hi,
Importing a 165mb meta-data export file into 2.24 would be awfully slow, in
particular if you have a lot of orgunits. I've regularly been
exporting/importing ~10,000 OU records - even if I actually only wanted to
update a few of them, but DHIS2 do not have any export filters for e.g.
lastupdated - and it would typically take several hours. The main culprit
is that these OrgUnits are being imported one by one (with a catalina entry
for each of them), and I think it is the same for many other objects.
The new export/import functionality is 2.25 and 2.26 is immensely much
faster, though - presumably because they are using more efficient sql code
(table comparisons instead of one by one). What took 3 hours in 2.24 takes
30 seconds or something in 2.25 and 2.26.
Bottom line: consider moving at least to 2.25, and import there. Otherwise
you just have to wait for it to finish....
Regards
Calle
On 13 February 2017 at 13:10, Anilkumar Kodi <anilkumk@xxxxxxxxxxxxxxxx>
wrote:
> Yes, we could see that process was still running, in logs we could see
> that there are no errors and it is creating, updating dataSets, orgUnits
> and orgGroups,.. etc.
>
>
> Thanks,
> Anil Kumar K
>
> On Mon, Feb 13, 2017 at 4:20 PM, Knut Staring <knutst@xxxxxxxxx> wrote:
>
>> Are you sure the process was actually running? No errors in the Tomcat
>> log?
>>
>> On Feb 13, 2017 10:43 AM, "Nalinikanth Meesala" <nalinim@xxxxxxxxxxxxxxxx>
>> wrote:
>>
>>> Hi,
>>>
>>> We are trying to import Meta data of dhis2 exported from (2.23) to our
>>> local instance DHIS 2(2.24) [as import of the exported metadata is not
>>> working in DHIS 2.23 ].
>>>
>>> The size of meta data is 164 mb can you please help in providing inputs
>>> to make the import faster. previously when we tried it took more than 2
>>> days and it was still running.
>>>
>>> Ca you please let us know any work around so that we can make it faster.
>>>
>>> --
>>> Thanks & Regards,
>>> Nalinikanth M
>>> Quality Analyst
>>> Email nalinim@xxxxxxxxxxxxxxxx
>>> Telephone +91 9052234588 <+91+9052234588>
>>> [image: ThoughtWorks]
>>> <http://www.thoughtworks.com/?utm_campaign=archana-chillala-signature&utm_medium=email&utm_source=thoughtworks-email-signature-generator>
>>>
>>> _______________________________________________
>>> Mailing list: https://launchpad.net/~dhis2-devs
>>> Post to : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>> More help : https://help.launchpad.net/ListHelp
>>>
>>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~dhis2-devs
>> Post to : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~dhis2-devs
>> More help : https://help.launchpad.net/ListHelp
>>
>>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~dhis2-devs
> Post to : dhis2-devs@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~dhis2-devs
> More help : https://help.launchpad.net/ListHelp
>
>
--
*******************************************
Calle Hedberg
46D Alma Road, 7700 Rosebank, SOUTH AFRICA
Tel/fax (home): +27-21-685-6472
Cell: +27-82-853-5352
Iridium SatPhone: +8816-315-19119
Email: calle.hedberg@xxxxxxxxx
Skype: calle_hedberg
*******************************************
Follow ups
References