← Back to team overview

dhis2-devs team mailing list archive

Re: [Dhis2-users] Timeout when updating large organisation unit group in large instance (2.23)

 

Ok, that's good to know, could be one more argument to push my upgrade
agenda. I'll play with the cache and try, thanks.

Martin

On Tue, Aug 29, 2017 at 9:06 AM, Morten Olav Hansen <morten@xxxxxxxxx>
wrote:

> Sorry, but the metadata importer was quite slow before ;-) it has been
> greatly improved in 224 and going forward...
>
> Did you try and enable the preheat parameter? preheatCache=true
>
> --
> Morten Olav Hansen
> Senior Engineer, DHIS 2
> University of Oslo
> http://www.dhis2.org
>
> On Tue, Aug 29, 2017 at 2:00 PM, Martin Van Aken <martin@xxxxxxxxxxxxxxxx>
> wrote:
>
>> Not sure I understand what you mean? Agree that the logical path is the
>> upgrade.
>>
>> Martin
>>
>> On Mon, Aug 28, 2017 at 10:20 PM, Morten Olav Hansen <morten@xxxxxxxxx>
>> wrote:
>>
>>> Sure, but if you are on 2.23... dot dot dot... some concessions has to
>>> be made
>>>
>>> --
>>> Morten Olav Hansen
>>> Senior Engineer, DHIS 2
>>> University of Oslo
>>> http://www.dhis2.org
>>>
>>> On Tue, Aug 29, 2017 at 2:07 AM, Martin Van Aken <
>>> martin@xxxxxxxxxxxxxxxx> wrote:
>>>
>>>> Agree on the upgrade but not every system we support is ours - ie
>>>> decision not 100% in our hands. We manage with the API for now, but that's
>>>> not practical for end users.
>>>>
>>>> Martin
>>>>
>>>> On Mon, Aug 28, 2017 at 8:47 PM, Morten Olav Hansen <morten@xxxxxxxxx>
>>>> wrote:
>>>>
>>>>> If you are willing to do manual import (using the command line), in
>>>>> 223 you can use /api/23/metadata I think... it will use the "new"
>>>>> importer.. which should be quicker, please be aware that 223 is not
>>>>> supported anymore, so please update ASAP if you can..
>>>>>
>>>>> --
>>>>> Morten Olav Hansen
>>>>> Senior Engineer, DHIS 2
>>>>> University of Oslo
>>>>> http://www.dhis2.org
>>>>>
>>>>> On Tue, Aug 29, 2017 at 1:09 AM, Martin Van Aken <
>>>>> martin@xxxxxxxxxxxxxxxx> wrote:
>>>>>
>>>>>> Hi Morten,
>>>>>> This is on 2.23 - I tried to manipulate big groups on the play demo
>>>>>> instance and it goes well there.
>>>>>>
>>>>>> I'll try to get some logs.
>>>>>>
>>>>>> Martin
>>>>>>
>>>>>> On Mon, Aug 28, 2017 at 5:27 PM, Morten Olav Hansen <morten@xxxxxxxxx
>>>>>> > wrote:
>>>>>>
>>>>>>> Hi Martin
>>>>>>>
>>>>>>> What version of DHIS2 are you on? if you are on 227 there is
>>>>>>> currently a bug that has lowered performance in 227 vs the older versions
>>>>>>> (226, 225, etc..)
>>>>>>>
>>>>>>> If you are not, if you could.. please file a JIRA issue and either
>>>>>>> attach the org units, or email me directly
>>>>>>>
>>>>>>> --
>>>>>>> Morten Olav Hansen
>>>>>>> Senior Engineer, DHIS 2
>>>>>>> University of Oslo
>>>>>>> http://www.dhis2.org
>>>>>>>
>>>>>>> On Mon, Aug 28, 2017 at 10:14 PM, Martin Van Aken <
>>>>>>> martin@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>
>>>>>>>> Hello Joseph,
>>>>>>>> Thanks for the feedback. I'll try rh
>>>>>>>>
>>>>>>>> On Mon, Aug 28, 2017 at 5:13 PM, Joseph K. Osborn <
>>>>>>>> osbornlegrand@xxxxxxxxxx> wrote:
>>>>>>>>
>>>>>>>>> Hello Martin,
>>>>>>>>>
>>>>>>>>> We had this problem with 2.22 or 2.23, the solution was to perform
>>>>>>>>> these updates during off-peak hours, times when the server was not too
>>>>>>>>> busy, so after 10pm, and it worked.
>>>>>>>>>
>>>>>>>>> But with 2.26 which has improved the analytic time and executions
>>>>>>>>> of several queries, we do our updates even during the day.
>>>>>>>>>
>>>>>>>>> Regards.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Osborn
>>>>>>>>> ------------------------------
>>>>>>>>> *De :* Dhis2-devs <dhis2-devs-bounces+osbornlegrand=
>>>>>>>>> hotmail.fr@xxxxxxxxxxxxxxxxxxx> de la part de Martin Van Aken <
>>>>>>>>> martin@xxxxxxxxxxxxxxxx>
>>>>>>>>> *Envoyé :* lundi 28 août 2017 15:34:53
>>>>>>>>> *À :* Michael Mwebaze
>>>>>>>>> *Cc :* dhis2-users; DHIS 2 Developers list
>>>>>>>>> *Objet :* Re: [Dhis2-devs] [Dhis2-users] Timeout when updating
>>>>>>>>> large organisation unit group in large instance (2.23)
>>>>>>>>>
>>>>>>>>> Got nothing until now but I'm investigating in that direction
>>>>>>>>> right now.
>>>>>>>>>
>>>>>>>>> Thanks already for the pointer!
>>>>>>>>>
>>>>>>>>> Martin
>>>>>>>>>
>>>>>>>>> On Mon, Aug 28, 2017 at 4:12 PM, Michael Mwebaze <
>>>>>>>>> michael.mwebaze@xxxxxxxxx> wrote:
>>>>>>>>>
>>>>>>>>>> Hi Martin,
>>>>>>>>>>
>>>>>>>>>> do you have access to the Tomcat logs? If an exception is being
>>>>>>>>>> thrown that would also be helpful to figure out what is happening.
>>>>>>>>>>
>>>>>>>>>> Regards,
>>>>>>>>>>
>>>>>>>>>> Michael
>>>>>>>>>>
>>>>>>>>>> On 28 August 2017 at 10:04, Martin Van Aken <
>>>>>>>>>> martin@xxxxxxxxxxxxxxxx> wrote:
>>>>>>>>>>
>>>>>>>>>>> Hi DHIS2 users & developers,
>>>>>>>>>>> We have a relatively large instance of DHIS2 (30 000 org units)
>>>>>>>>>>> where we have several groups that can make up to 3 000 org unit each.
>>>>>>>>>>>
>>>>>>>>>>> When trying to update them through the UX, our server get a
>>>>>>>>>>> timeout (looking in the console for the network calls).
>>>>>>>>>>>
>>>>>>>>>>> The call is like this:
>>>>>>>>>>>
>>>>>>>>>>> /api/organisationUnitGroups/RZYPaa6gxq8?mergeMode=REPLACE
>>>>>>>>>>>
>>>>>>>>>>> When using the API, we get no problem but we typically
>>>>>>>>>>> add/remove relations one by one (so the call is very different).
>>>>>>>>>>>
>>>>>>>>>>>  I tested on the last version on play and everything is working
>>>>>>>>>>> there, but the version is quite different too.
>>>>>>>>>>>
>>>>>>>>>>> Is this something someone encountered already? Anything we could
>>>>>>>>>>> do to avoid this ?
>>>>>>>>>>>
>>>>>>>>>>> Thanks,
>>>>>>>>>>>
>>>>>>>>>>> Martin
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --
>>>>>>>>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>>>>>>>>
>>>>>>>>>>> Mobile : +32 486 899 652
>>>>>>>>>>>
>>>>>>>>>>> Follow me on Twitter : @martinvanaken
>>>>>>>>>>> <http://twitter.com/martinvanaken>
>>>>>>>>>>> Call me on Skype : vanakenm
>>>>>>>>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>>>>>>>>> Contact me on LinkedIn : http://www.linkedin.com/in/m
>>>>>>>>>>> artinvanaken
>>>>>>>>>>> Company website : www.joyouscoding.com
>>>>>>>>>>>
>>>>>>>>>>> _______________________________________________
>>>>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>>>>>>
>>>>>>>>> Mobile : +32 486 899 652
>>>>>>>>>
>>>>>>>>> Follow me on Twitter : @martinvanaken
>>>>>>>>> <http://twitter.com/martinvanaken>
>>>>>>>>> Call me on Skype : vanakenm
>>>>>>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>>>>>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>>>>>>>> Company website : www.joyouscoding.com
>>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>> --
>>>>>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>>>>>
>>>>>>>> Mobile : +32 486 899 652
>>>>>>>>
>>>>>>>> Follow me on Twitter : @martinvanaken
>>>>>>>> <http://twitter.com/martinvanaken>
>>>>>>>> Call me on Skype : vanakenm
>>>>>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>>>>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>>>>>>> Company website : www.joyouscoding.com
>>>>>>>>
>>>>>>>> _______________________________________________
>>>>>>>> Mailing list: https://launchpad.net/~dhis2-users
>>>>>>>> Post to     : dhis2-users@xxxxxxxxxxxxxxxxxxx
>>>>>>>> Unsubscribe : https://launchpad.net/~dhis2-users
>>>>>>>> More help   : https://help.launchpad.net/ListHelp
>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>> --
>>>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>>>
>>>>>> Mobile : +32 486 899 652
>>>>>>
>>>>>> Follow me on Twitter : @martinvanaken
>>>>>> <http://twitter.com/martinvanaken>
>>>>>> Call me on Skype : vanakenm
>>>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>>>>> Company website : www.joyouscoding.com
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>> --
>>>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>>>
>>>> Mobile : +32 486 899 652
>>>>
>>>> Follow me on Twitter : @martinvanaken
>>>> <http://twitter.com/martinvanaken>
>>>> Call me on Skype : vanakenm
>>>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>>>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>>>> Company website : www.joyouscoding.com
>>>>
>>>
>>>
>>
>>
>> --
>> *Martin Van Aken - **Freelance Enthusiast Developer*
>>
>> Mobile : +32 486 899 652
>>
>> Follow me on Twitter : @martinvanaken <http://twitter.com/martinvanaken>
>> Call me on Skype : vanakenm
>> Hang out with me : martin@xxxxxxxxxxxxxxxx
>> Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
>> Company website : www.joyouscoding.com
>>
>
>


-- 
*Martin Van Aken - **Freelance Enthusiast Developer*

Mobile : +32 486 899 652

Follow me on Twitter : @martinvanaken <http://twitter.com/martinvanaken>
Call me on Skype : vanakenm
Hang out with me : martin@xxxxxxxxxxxxxxxx
Contact me on LinkedIn : http://www.linkedin.com/in/martinvanaken
Company website : www.joyouscoding.com

References