dolfin team mailing list archive
-
dolfin team
-
Mailing list archive
-
Message #18516
Re: Benchmarks, update
-
To:
dolfin@xxxxxxxxxxxxxxxxxxx
-
From:
Marie Rognes <meg@xxxxxxxxx>
-
Date:
Mon, 07 Jun 2010 15:05:46 +0200
-
In-reply-to:
<20100607112402.GP7611@olorin>
-
User-agent:
Mozilla/5.0 (X11; U; Linux x86_64; en-US; rv:1.9.1.9) Gecko/20100516 Thunderbird/3.0.4
On 07. juni 2010 13:24, Anders Logg wrote:
> On Wed, May 05, 2010 at 10:32:07AM +0200, Anders Logg wrote:
>
>> On Wed, May 05, 2010 at 09:11:21AM +0100, Garth N. Wells wrote:
>>
>>>
>>> On 03/05/10 14:04, Anders Logg wrote:
>>>
>>>> I've been going through all benchmarks and made changes to get
>>>> everything to compile and run properly. I've also made adjustments to
>>>> some parameters to get reasonable running times.
>>>>
>>>> I'm currently working on the parallel speedup benchmark (fem/speedup)
>>>> but then I think we should be in pretty good shape (for now).
>>>>
>>>> It would be good for everyone that has any interest in the benchmark
>>>> suite to take a look now at all the benchmarks and see if something
>>>> can be improved. As mentioned before, Johannes will backport at least
>>>> some of the benchmarks to earlier versions and then it becomes very
>>>> important that we keep the benchmarks fixed. We can't artibrarily go
>>>> in and change say a mesh size or form since that would break the
>>>> history.
>>>>
>>>> So speak now or forever hold your peace.
>>>>
>>>>
>>> I won't be able to look at the benchmarks for a while, but I would
>>> like to have benchmarks to cover some areas where I know DOLFIN
>>> could do with some performance improvements. Off the top of my head
>>> two areas are:
>>>
>>> - Assembly of forms with many coefficients (calls to eval(..) are slow)
>>>
>> It is easy to add more test cases to bench/fem/assembly/cpp/. Ideally,
>> they should be added before recording historical data. Both individual
>> and total running time is recorded so only the total time would be
>> messed up if we add a new test case, but if we want historical timings
>> for handling of coefficients (which might be important since that is
>> something we have been changing around) we should add it now.
>>
>> Do you have any particular case(s) in mind? It's very easy to add so
>> we could do it quickly.
>>
>>
>>> - Repeated solution of linear systems (reuse of preconditioners,
>>> reuse of symbolic factorisation, etc)
>>>
>> Those are new test cases so they can just be added when we feel like
>> it (but we might not get historical data).
>>
> Does anyone have any more test cases to add? If not, it might be a
> good time to ask Johannes to look at the tests and try to backport
> them to earlier version.
>
> I am semi-happy with our current set of benchmarks. If anyone wants to
> add something, please do it now (or announce that you plan to add
> something).
>
> Here's the current list:
>
> http://www.fenics.org/bench/
>
> All benchmarks are available in dolfin/bench.
>
I would very much like an extrapolation speed test. Will make one, if ok.
--
Marie
Follow ups
References