launchpad-reviewers team mailing list archive

[Ines Almeida <mp+458930@xxxxxxxxxxxxxxxxxx>]

I think we need to be practical: We either need to take the time to improve our test and build systems properly, or we reduce the flakyness test by test - the first is much better, but we currently we are doing neither.

I <b>100%</b> think that we need to take the time to go deep into this. But while we don't, our builds fail more than 50% of the time due to 1 or 2 flaky tests failing. This often brings hours (if not days, sometimes) of delay in deployments.

FWIW, I ran this test with a 0.2 second timeout locally with `--repeat 20` and it always ran successfully (it fails if I set the timeout to 0.1). But when the buildbot runs it, sometimes it somehow takes longer than 30 seconds.
Also FWIW, I don't expect this to add 30 seconds to the test run - it only fails from time to time, so it probably takes only slightly longer than the 30 seconds.

So although this is not the best solution, it's at least something.

Happy to discuss this at stand-up tomorrow!
-- 
https://code.launchpad.net/~ines-almeida/launchpad/+git/launchpad/+merge/458930
Your team Launchpad code reviewers is requested to review the proposed merge of ~ines-almeida/launchpad:increase-unittest-fetch-timeout into launchpad:master.