← Back to team overview

maria-developers team mailing list archive

Re: For Google Summer of Code 2014, Interested in the task of "statistically optimize mysql-test runs by running less tests"


Hi, Zhongyi Hu!

On Mar 17, Zhongyi Hu wrote:
> Hi, Sergei Golubchik!
> I am afraid I don't understand the following items very well, could you
> explain them for me?
>    - average over different combinations or builders
>    - or don't average and treat triplets (test,combination,builder) as
>    individual "tests"

Individual test files (say, select.test) run on different builders (say,
on win64, and on fedora20-i686, etc).

Test files fail with different probabilities. These probabilities may be
different for different builders.

One can calculate a "test failure probability" as a function of
probabilities for this test file to fail on different builders.

Alternatively, one cat treat the "select.test run on win64" and
"select.test run on fedora20-i686" as two different tests.


Follow ups