dhis2-devs team mailing list archive
-
dhis2-devs team
-
Mailing list archive
-
Message #18899
Re: Problem creating datamart
I might found an alternative solution. Yesterday we run data mart for 9
month and it was completed successfully but when we run for 5 years, the
errors arrived.
Today and trying with again and get back to you all with the result. But
when we run datamart for 9 moth it takes 34 minutes, which is long is not
it?
Regards
Hannan
On Tue, Sep 11, 2012 at 2:01 PM, Morten Olav Hansen <mortenoh@xxxxxxxxx>wrote:
> That's a really big database... I think maybe Lars should answer if the
> memory of the server is large enough (I'm sure he can compare it with what
> he has been doing to tune the Kenya server).
>
> --
> Morten
>
>
>
> On Tue, Sep 11, 2012 at 2:59 PM, Hannan Khan <hannank@xxxxxxxxx> wrote:
>
>> Hi Morten
>>
>> Server have 8GB memory and database is 3159MB. We are using MySQL.
>>
>> Regards
>>
>> Hannan
>>
>>
>> On Tue, Sep 11, 2012 at 1:53 PM, Morten Olav Hansen <mortenoh@xxxxxxxxx>wrote:
>>
>>> Hi
>>>
>>> How much memory does your server have? and what is the size of your
>>> database?
>>>
>>> --
>>> Morten
>>>
>>>
>>>
>>> On Tue, Sep 11, 2012 at 2:51 PM, Hannan Khan <hannank@xxxxxxxxx> wrote:
>>>
>>>> -XX:MaxPermSize=2048m and -XX:PermSize=512m
>>>>
>>>>
>>>> On Tue, Sep 11, 2012 at 11:27 AM, Jason Pickering <
>>>> jason.p.pickering@xxxxxxxxx> wrote:
>>>>
>>>>> The PergGen space is the important option. What are you JAVA_OPTS.?
>>>>>
>>>>> --
>>>>> Sent from my mobile
>>>>> On Sep 11, 2012 7:25 AM, "Hannan Khan" <hannank@xxxxxxxxx> wrote:
>>>>>
>>>>>> Thanks Jason.
>>>>>>
>>>>>> I put the Java heap space 1GB and Maximum 6GB (Xmx6144m and
>>>>>> Xms1024m). But still getting 'java.lang.OutOfMemoryError: Java heap space'
>>>>>> error. That why I asked that whether that is a bug or not.
>>>>>>
>>>>>> I am trying to other options and contact you soon.
>>>>>>
>>>>>> Regards
>>>>>>
>>>>>> Hannan
>>>>>>
>>>>>> On Mon, Sep 10, 2012 at 11:40 AM, Jason Pickering <
>>>>>> jason.p.pickering@xxxxxxxxx> wrote:
>>>>>>
>>>>>>> Hi Hannan,
>>>>>>>
>>>>>>> You configuration may have worked previously, but some things were
>>>>>>> changed in the datamart and you will need to allocate more memory to
>>>>>>> it after 2.7.
>>>>>>>
>>>>>>> The details are here of the server setup are here
>>>>>>>
>>>>>>> http://dhis2.org/doc/snapshot/en/implementer/html/ch08.html#d5e413
>>>>>>>
>>>>>>> and the important part is the JAVA_OPTS environment variable, for
>>>>>>> instance...
>>>>>>>
>>>>>>> export JAVA_OPTS='-Xmx6000m -Xms3000m -XX:MaxPermSize=800m
>>>>>>> -XX:PermSize=400m'
>>>>>>>
>>>>>>> I am not really sure what your settings are, but you should at least
>>>>>>> specify these options, of course adjusting them for the amount of
>>>>>>> memory which can be allocated to DHIS2 .
>>>>>>>
>>>>>>> Best regards,
>>>>>>> Jason
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>> On Mon, Sep 10, 2012 at 10:49 AM, Hannan Khan <hannank@xxxxxxxxx>
>>>>>>> wrote:
>>>>>>> > Dear Jason
>>>>>>> >
>>>>>>> > Thanks for your advice. We are running dhis2 from 2010. In earlier
>>>>>>> version
>>>>>>> > we dont have any problem creating datamart. After updating to
>>>>>>> version 2.7 we
>>>>>>> > imported a big chuck of data from two data souce and after that we
>>>>>>> have
>>>>>>> > problem creating datamart.
>>>>>>> >
>>>>>>> > So far I know the configuration is ok, however I will check again
>>>>>>> and get
>>>>>>> > back to you.
>>>>>>> >
>>>>>>> > Regards
>>>>>>> >
>>>>>>> > Hannan
>>>>>>> > from Samsung Galaxy
>>>>>>> >
>>>>>>> > On Sep 9, 2012 5:39 PM, "Jason Pickering" <
>>>>>>> jason.p.pickering@xxxxxxxxx>
>>>>>>> > wrote:
>>>>>>> >>
>>>>>>> >> This is not a bug. You must increase the heap size. Please
>>>>>>> consult the
>>>>>>> >> implementation manual for details.
>>>>>>> >>
>>>>>>> >> Regards,
>>>>>>> >> Jason
>>>>>>> >>
>>>>>>> >> --
>>>>>>> >> Sent from my mobile
>>>>>>> >>
>>>>>>> >> On Sep 9, 2012 1:12 PM, "Hannan Khan" <hannank@xxxxxxxxx> wrote:
>>>>>>> >>>
>>>>>>> >>> We are using dhis2 version 2.7. Whenever we generating datamart
>>>>>>> are it
>>>>>>> >>> taking long time and it never ends.The error message is (in the
>>>>>>> tomcat log
>>>>>>> >>> file)
>>>>>>> >>>
>>>>>>> 'dhis2-org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor
>>>>>>> >>> processChildren SEVERE: Exception invoking periodic operation:
>>>>>>> >>> java.lang.OutOfMemoryError: Java heap space'.
>>>>>>> >>>
>>>>>>> >>> I attached the log file.
>>>>>>> >>>
>>>>>>> >>> Regards
>>>>>>> >>>
>>>>>>> >>> Hannan Khan
>>>>>>> >>>
>>>>>>> >>> National Data Warehouse
>>>>>>> >>>
>>>>>>> >>>
>>>>>>> >>>
>>>>>>> >>>
>>>>>>> >>> _______________________________________________
>>>>>>> >>> Mailing list: https://launchpad.net/~dhis2-devs
>>>>>>> >>> Post to : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>>>>> >>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>>>>>> >>> More help : https://help.launchpad.net/ListHelp
>>>>>>> >>>
>>>>>>> >
>>>>>>>
>>>>>>
>>>>>>
>>>>
>>>> _______________________________________________
>>>> Mailing list: https://launchpad.net/~dhis2-devs
>>>> Post to : dhis2-devs@xxxxxxxxxxxxxxxxxxx
>>>> Unsubscribe : https://launchpad.net/~dhis2-devs
>>>> More help : https://help.launchpad.net/ListHelp
>>>>
>>>>
>>>
>>
>
Follow ups
References
-
Problem creating datamart
From: Hannan Khan, 2012-09-09
-
Re: Problem creating datamart
From: Jason Pickering, 2012-09-09
-
Re: Problem creating datamart
From: Hannan Khan, 2012-09-10
-
Re: Problem creating datamart
From: Jason Pickering, 2012-09-10
-
Re: Problem creating datamart
From: Hannan Khan, 2012-09-11
-
Re: Problem creating datamart
From: Jason Pickering, 2012-09-11
-
Re: Problem creating datamart
From: Hannan Khan, 2012-09-11
-
Re: Problem creating datamart
From: Morten Olav Hansen, 2012-09-11
-
Re: Problem creating datamart
From: Hannan Khan, 2012-09-11
-
Re: Problem creating datamart
From: Morten Olav Hansen, 2012-09-11