maria-developers team mailing list archive

[Elena Stepanova <elenst@xxxxxxxxxxxxxxxx>]

Hi Pablo,

One more note:

On 17.06.2014 12:16, Pablo Estrada wrote:

>     - Add randomized running of tests that have not ran or been modified - I
>     will make this optional.

I think it will be very useful for the *research* part if you make the 
seed for this randomization deterministic for every particular test run 
(or make it configurable); e.g. you can use the timestamp of the test 
run as a seed. This way you will keep results invariant. Otherwise when 
you run consequent experiments with the same parameters, you will be 
getting different results, which might be confusing and difficult to 
interpret.

Regards,
Elena