← Back to team overview

dolfin team mailing list archive

Re: Benchmarks, update

 

On Mon, Jun 07, 2010 at 03:05:46PM +0200, Marie Rognes wrote:
> On 07. juni 2010 13:24, Anders Logg wrote:
> > On Wed, May 05, 2010 at 10:32:07AM +0200, Anders Logg wrote:
> >
> >> On Wed, May 05, 2010 at 09:11:21AM +0100, Garth N. Wells wrote:
> >>
> >>>
> >>> On 03/05/10 14:04, Anders Logg wrote:
> >>>
> >>>> I've been going through all benchmarks and made changes to get
> >>>> everything to compile and run properly. I've also made adjustments to
> >>>> some parameters to get reasonable running times.
> >>>>
> >>>> I'm currently working on the parallel speedup benchmark (fem/speedup)
> >>>> but then I think we should be in pretty good shape (for now).
> >>>>
> >>>> It would be good for everyone that has any interest in the benchmark
> >>>> suite to take a look now at all the benchmarks and see if something
> >>>> can be improved. As mentioned before, Johannes will backport at least
> >>>> some of the benchmarks to earlier versions and then it becomes very
> >>>> important that we keep the benchmarks fixed. We can't artibrarily go
> >>>> in and change say a mesh size or form since that would break the
> >>>> history.
> >>>>
> >>>> So speak now or forever hold your peace.
> >>>>
> >>>>
> >>> I won't be able to look at the benchmarks for a while, but I would
> >>> like to have benchmarks to cover some areas where I know DOLFIN
> >>> could do with some performance improvements. Off the top of my head
> >>> two areas are:
> >>>
> >>> - Assembly of forms with many coefficients (calls to eval(..) are slow)
> >>>
> >> It is easy to add more test cases to bench/fem/assembly/cpp/. Ideally,
> >> they should be added before recording historical data. Both individual
> >> and total running time is recorded so only the total time would be
> >> messed up if we add a new test case, but if we want historical timings
> >> for handling of coefficients (which might be important since that is
> >> something we have been changing around) we should add it now.
> >>
> >> Do you have any particular case(s) in mind? It's very easy to add so
> >> we could do it quickly.
> >>
> >>
> >>> - Repeated solution of linear systems (reuse of preconditioners,
> >>> reuse of symbolic factorisation, etc)
> >>>
> >> Those are new test cases so they can just be added when we feel like
> >> it (but we might not get historical data).
> >>
> > Does anyone have any more test cases to add? If not, it might be a
> > good time to ask Johannes to look at the tests and try to backport
> > them to earlier version.
> >
> > I am semi-happy with our current set of benchmarks. If anyone wants to
> > add something, please do it now (or announce that you plan to add
> > something).
> >
> > Here's the current list:
> >
> >   http://www.fenics.org/bench/
> >
> > All benchmarks are available in dolfin/bench.
> >
>
>
> I would very much like an extrapolation speed test. Will make one, if ok.

Great. Just add it.

--
Anders

Attachment: signature.asc
Description: Digital signature


References