← Back to team overview

dhis2-users team mailing list archive

Re: [Dhis2-devs] Timeout when updating large organisation unit group in large instance (2.23)

 

Sorry, but the metadata importer was quite slow before ;-) it has been
greatly improved in 224 and going forward...

Did you try and enable the preheat parameter? preheatCache=true

-- 
Morten Olav Hansen
Senior Engineer, DHIS 2
University of Oslo
http://www.dhis2.org

On Tue, Aug 29, 2017 at 2:00 PM, Martin Van Aken <martin@xxxxxxxxxxxxxxxx>
wrote:

> Not sure I understand what you mean? Agree that the logical path is the
> upgrade.
>
> Martin
>
> On Mon, Aug 28, 2017 at 10:20 PM, Morten Olav Hansen <morten@xxxxxxxxx>
> wrote:
>
>> Sure, but if you are on 2.23... dot dot dot... some concessions has to be
>> made
>>
>> --
>> Morten Olav Hansen
>> Senior Engineer, DHIS 2
>> University of Oslo
>> http://www.dhis2.org
>>
>> On Tue, Aug 29, 2017 at 2:07 AM, Martin Van Aken <martin@xxxxxxxxxxxxxxxx
>> > wrote:
>>
>>> Agree on the upgrade but not every system we support is ours - ie
>>> decision not 100% in our hands. We manage with the API for now, but that's
>>> not practical for end users.
>>>
>>> Martin
>>>
>>> On Mon, Aug 28, 2017 at 8:47 PM, Morten Olav Hansen <morten@xxxxxxxxx>
>>> wrote:
>>>
>>>> If you are willing to do manual import (using the command line), in 223
>>>> you can use /api/23/metadata I think... it will use the "new" importer..
>>>> which should be quicker, please be aware that 223 is not supported anymore,
>>>> so please update ASAP if you can..
>>>>
>>>> --
>>>> Morten Olav Hansen
>>>> Senior Engineer, DHIS 2
>>>> University of Oslo
>>>> http://www.dhis2.org
>>>>
>>>> On Tue, Aug 29, 2017 at 1:09 AM, Martin Van Aken <
>>>> martin@xxxxxxxxxxxxxxxx> wrote:
>>>>
>>>>> Hi Morten,
>>>>> This is on 2.23 - I tried to manipulate big groups on the play demo
>>>>> instance and it goes well there.
>>>>>
>>>>> I'll try to get some logs.
>>>>>
>>>>> Martin
>>>>>
>>>>> On Mon, Aug 28, 2017 at 5:27 PM, Morten Olav Hansen <morten@xxxxxxxxx>
>>>>> wrote:
>>>>>
>>>>>> Hi Martin
>>>>>>
>>>>>> What version of DHIS2 are you on? if you are on 227 there is
>>>>>> currently a bug that has lowered performance in 227 vs the older versions
>>>>>> (226, 225, etc..)
>>>>>>
>>>>>> If you are not, if you could.. please file a JIRA issue and either
>>>>>> attach the org units, or email me directly
>>>>>>
>>>>>> --
>>>>>> Morten Olav Hansen
>>>>>> Senior Engineer, DHIS 2
>>>>>> University of Oslo
>>>>>> http://www.dhis2.org
>>>>>>
>>>>>> On Mon, Aug 28, 2017 at 10:14 PM, Martin Van Aken <
>>>>>> martin@xxxxxxxxxxxxxxxx> wrote:
>>>>>>
>>>>>>> Hello Joseph,
>>>>>>> Thanks for the feedback. I'll try rh
>>>>>>>
>>>>>>> On Mon, Aug 28, 2017 at 5:13 PM, Joseph K. Osborn <
>>>>>>> osbornlegrand@xxxxxxxxxx> wrote:
>>>>>>>
>>>>>>>> Hello Martin,
>>>>>>>>
>>>>>>>> We had this problem with 2.22 or 2.23, the solution was to perform
>>>>>>>> these updates during off-peak hours, times when the server was not too
>>>>>>>> busy, so after 10pm, and it worked.
>>>>>>>>
>>>>>>>> But with 2.26 which has improved the analytic time and executions
>>>>>>>> of several queries, we do our updates even during the day.
>>>>>>>>
>>>>>>>> Regards.
>>>>>>>>
>>>>>>>>
>>>>>>>> Osborn
>>>>>>>> ------------------------------
>>>>>>>> *De :* Dhis2-devs <dhis2-devs-bounces+osbornlegrand=
>>>>>>>> hotmail.fr@xxxxxxxxxxxxxxxxxxx> de la part de Martin Van Aken <
>>>>>>>> martin@xxxxxxxxxxxxxxxx>
>>>>>>>> *Envoyé :* lundi 28 août 2017 15:34:53
>>>>>>>> *À :* Michael Mwebaze
>>>>>>>> *Cc :* dhis2-users; DHIS 2 Developers list
>>>>>>>> *Objet :* Re: [Dhis2-devs] [Dhis2-users] Timeout when updating
>>>>>>>> large organisation unit group in large instance (2.23)
>>>>>>>>
>>>>>>>> Got nothing until now but I'm investigating in that direction right
>>>>>>>> now.
>>>>>>>>
>>>>>>>> Thanks already for the pointer!
>>>>>>>>
>>>>>>>> Martin
>>>>>>>>
>>>>>>>> On Mon, Aug 28, 2017 at 4:12 PM, Michael Mwebaze <
>>>>>>>> michael.mwebaze@xxxxxxxxx> wrote:
>>>>>>>>
>>>>>>>>> Hi Martin,
>>>>>>>>>
>>>>>>>>> do you have access to the Tomcat logs? If an exception is being
>>>>>>>>> thrown that would also be helpful to figure out what is happening.
>>>>>>>>>
>>>>>>>>> Regards,
>>>>>>>>>
>>>>>>>>> Michael
>>>>>>>>>
>>>>>>>>> On 28 August 2017 at 10:04, Martin Van Aken <
>>>>>>>>> martin@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>
>>>>>>>>>> Hi DHIS2 users & developers,
>>>>>>>>>> We have a relatively large instance of DHIS2 (30 000 org units)
>>>>>>>>>> where we have several groups that can make up to 3 000 org unit each.
>>>>>>>>>>
>>>>>>>>>> When trying to update them through the UX, our server get a
>>>>>>>>>> timeout (looking in the console for the network calls).
>>>>>>>>>>
>>>>>>>>>> The call is like this:
>>>>>>>>>>
>>>>>>>>>> /api/organisationUnitGroups/RZYPaa6gxq8?mergeMode=REPLACE
>>>>>>>>>>
>>>>>>>>>> When using the API, we get no problem but we typically add/remove
>>>>>>>>>> relations one by one (so the call is very different).
>>>>>>>>>>
>>>>>>>>>>  I tested on the last version on play and everything is working
>>>>>>>>>> there, but the version is quite different too.
>>>>>>>>>>
>>>>>>>>>> Is this something someone encountered already? Anything we could
>>>>>>>>>> do to avoid this ?
>>>>>>>>>>
>>>>>>>>>> Thanks,
>>>>>>>>>>
>>>>>>>>>> Martin
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>> --
>>>>>>>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>>>>>>>
>>>>>>>>>> Mobile : +32 486 899 652
>>>>>>>>>>
>>>>>>>>>> Follow me on Twitter : @martinvanaken
>>>>>>>>>> <http://twitter.com/martinvanaken>
>>>>>>>>>> Call me on Skype : vanakenm
>>>>>>>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>>>>>>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>>>>>>>>> Company website : www.joyouscoding.com
>>>>>>>>>>
>>>>>>>>>> _______________________________________________
>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>>>>>
>>>>>>>> Mobile : +32 486 899 652
>>>>>>>>
>>>>>>>> Follow me on Twitter : @martinvanaken
>>>>>>>> <http://twitter.com/martinvanaken>
>>>>>>>> Call me on Skype : vanakenm
>>>>>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>>>>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>>>>>>> Company website : www.joyouscoding.com
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>>>>
>>>>>>> Mobile : +32 486 899 652
>>>>>>>
>>>>>>> Follow me on Twitter : @martinvanaken
>>>>>>> <http://twitter.com/martinvanaken>
>>>>>>> Call me on Skype : vanakenm
>>>>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>>>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>>>>>> Company website : www.joyouscoding.com
>>>>>>>
>>>>>>> _______________________________________________
>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>> --
>>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>>
>>>>> Mobile : +32 486 899 652
>>>>>
>>>>> Follow me on Twitter : @martinvanaken
>>>>> <http://twitter.com/martinvanaken>
>>>>> Call me on Skype : vanakenm
>>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>>>> Company website : www.joyouscoding.com
>>>>>
>>>>
>>>>
>>>
>>>
>>> --
>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>
>>> Mobile : +32 486 899 652
>>>
>>> Follow me on Twitter : @martinvanaken <http://twitter.com/martinvanaken>
>>> Call me on Skype : vanakenm
>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>> Company website : www.joyouscoding.com
>>>
>>
>>
>
>
> --
> *Martin Van Aken - **Freelance Enthusiast Developer*
>
> Mobile : +32 486 899 652
>
> Follow me on Twitter : @martinvanaken <http://twitter.com/martinvanaken>
> Call me on Skype : vanakenm
> Hang out with me : martin@xxxxxxxxxxxxxxxx
> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
> Company website : www.joyouscoding.com
>

Follow ups

References