yade-dev team mailing list archive
-
yade-dev team
-
Mailing list archive
-
Message #06424
Re: TriaxialTest regression tests.
I think it is better to commit it into the trunk. Because it will be
necessary to change syntax after some trunk updates.
Anton
On Mon, Dec 6, 2010 at 9:12 AM, Bruno Chareyre
<bruno.chareyre@xxxxxxxxxxx>wrote:
> I got the same idea this WE. Maybe commit scripts and results in
> trunk/scripts/checks, or
> upload them on wiki - as they can give at the same time simulation
> exemples?
>
> Bruno
>
> On 06/12/10 09:06, Anton Gladky wrote:
> > Ok, I think it is good to have such tests anyway. We can keep them
> > separately from regression ones.
> > Let's call "check tests" or...
> >
> > And they should not be mandatory for packaging. "Just to check". If
> > somebody commits something and it sufficiently changes result value - it
> > can be serious.
> >
> > I usually do it, for my tests. I compile new YADE version and start
> > there my "standart" test with "-j 1" to have always the same results. If
> > it is ok - I use new YADE-version for work.
> >
> > I think it is relatively easy to do. Anybody can give their 'common"
> > test with usual result value (for example strength of specimen) and we
> > can compare this value from version to version. And it is good way to
> > check constitutive laws, geometry-modules etc.
> >
> > What do you think?
> >
> > Anton
> >
> >
> >
> > On Fri, Dec 3, 2010 at 8:26 PM, Bruno Chareyre
> > <bruno.chareyre@xxxxxxxxxxx <mailto:bruno.chareyre@xxxxxxxxxxx>> wrote:
> >
> > On 03/12/10 17:13, Václav Šmilauer wrote:
> > > Hi Anton, I am quite opposed to adding regression tests where the
> > result
> > > cannot be established analytically, because they don't indicate
> whether
> > > a failure is actually a "progression" or "regression". We discussed
> > that
> > > with Bruno, who does not agree, few months back already. v
> > >> As I understand TriaxialTest one of the most popular test in Yade.
> > >> Can anybody add a regression test for that?
> >
> > I see pros and cons.
> >
> > There is much implication on how yade is developped.
> > Currently, the situation when you work on someting, do other things
> > for a few days, then
> > update and find different behaviour when you resume coding is quite
> > common. Vaclav is
> > doing a lot to put warnings at compile- and run-time to help people
> > fix their code and
> > scripts.
> > But still, there are many ways for commiters to break someone-else's
> > work without notice.
> > With last changes in cohesive laws, all my scripts testing
> > cylinder-sphere-wall problems
> > were broken, if I had been away for a few days it would have taken
> > some time to figure out
> > why, because it concerns some code still in development, that didn't
> > work even before the
> > commit (not blaming Chiara, just mentionning the usefulness of the
> > corresponding reg. test).
> >
> > It explains a lot regarding why McGill FEM-DEM coupling, Feng-Chen's
> > CFD-DEM, Luc's
> > LBM-DEM are not in the trunk, and why so many users will never
> update.
> > If more people were putting a basic regression test corresponding to
> > what they are
> > developping, it would put more responsability on commiters, and it
> > would help to clearly
> > indentify what commit modified a given behaviour.
> >
> > OTOH, it is clear that (1) a change is not always a bad thing, and
> > that (2) global tests
> > can sometimes give false alarms.
> >
> > For (1), I think it is not really a difficult problem. For instance
> > : if I identify a
> > mistake in, lets say, Newton Integration, I can expect that all
> > "global" regression tests
> > using Newton will send warnings. I can even update the target values
> > in reg. tests before
> > commiting. I can't imagine a situation where someone would improve
> > something or fix a bug
> > that was affecting everybody, without realizing that it is really
> > affecting everybody.
> > Anyway, if someone fixes a bug that would have been affecting
> > triaxial test for so many
> > years, it should be notified to all TT users.
> >
> > For (2), it will happen. It happened, in fact, the first time
> > cohesive-chain test failed
> > (testing compiler-sensitive numerical noise). The second warning was
> > real though. Clearly,
> > one should think twice before defining target values and warning
> > threshold.
> >
> > Unit tests testing each small thing separately are very usefull. The
> > only problem is they
> > hardly identify 1% of the "oh god, why is it not like yesterday"
> > problems that makes the
> > daily life of yade users.
> >
> > My two cents.
> >
> > Bruno
> >
> > _______________________________________________
> > Mailing list: https://launchpad.net/~yade-dev<https://launchpad.net/%7Eyade-dev>
> > <https://launchpad.net/%7Eyade-dev>
> > Post to : yade-dev@xxxxxxxxxxxxxxxxxxx
> > <mailto:yade-dev@xxxxxxxxxxxxxxxxxxx>
> > Unsubscribe : https://launchpad.net/~yade-dev<https://launchpad.net/%7Eyade-dev>
> > <https://launchpad.net/%7Eyade-dev>
> > More help : https://help.launchpad.net/ListHelp
> >
> >
> >
> >
> > _______________________________________________
> > Mailing list: https://launchpad.net/~yade-dev<https://launchpad.net/%7Eyade-dev>
> > Post to : yade-dev@xxxxxxxxxxxxxxxxxxx
> > Unsubscribe : https://launchpad.net/~yade-dev<https://launchpad.net/%7Eyade-dev>
> > More help : https://help.launchpad.net/ListHelp
>
> --
> _______________
> Bruno Chareyre
> Associate Professor
> ENSE³ - Grenoble INP
> Lab. 3SR
> BP 53 - 38041, Grenoble cedex 9 - France
> Tél : +33 4 56 52 86 21
> Fax : +33 4 76 82 70 43
> ________________
>
> _______________________________________________
> Mailing list: https://launchpad.net/~yade-dev<https://launchpad.net/%7Eyade-dev>
> Post to : yade-dev@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~yade-dev<https://launchpad.net/%7Eyade-dev>
> More help : https://help.launchpad.net/ListHelp
>
Follow ups
References