← Back to team overview

maria-developers team mailing list archive

Re: [GSoC] Optimize mysql-test-runs - Setback


Hi Pablo,

One more note:

On 17.06.2014 12:16, Pablo Estrada wrote:

    - Add randomized running of tests that have not ran or been modified - I
    will make this optional.

I think it will be very useful for the *research* part if you make the seed for this randomization deterministic for every particular test run (or make it configurable); e.g. you can use the timestamp of the test run as a seed. This way you will keep results invariant. Otherwise when you run consequent experiments with the same parameters, you will be getting different results, which might be confusing and difficult to interpret.


Follow ups