xorg-prop-drivers-testers team mailing list archive

[Bryce Harrington <bryce@xxxxxxxxxxxxx>]

On Mon, Apr 19, 2010 at 10:51:12AM +0200, Ara Pulido wrote:
> Hello all,
> 
> I have posted Week 10 in the tracker [1], which is the last week of our
> weekly testing. Next week we will be focusing in testing the final Lucid
> release.
> 
> I want to thank everyone who participated during all these weeks. Your
> participation in testing, in replying to the mailing list, etc. is very
> important to Ubuntu's success.

Thank you from me as well.  I didn't reply to the list all the time, but
I did review the bug tracker each week to see if there were any serious
regressions.  This release we were lucky and didn't run into issues like
last time when gdm2 and plymouth changed late in the cycle.

A few things I would change...

* We had several test cases which always failed.  I think we could have
  communicated these as "expected failures" better, or maybe left them
  out of the test plan.

* Currently there isn't an easy way for bug reporters to indicate if a
  bug they encounter is a regression, vs. just a regular issue they just
  hadn't reported before.  For this process we care a LOT about
  regressions, so would be nice to have a way to flag them better.

* There should be some mechanism to escalate discoveries of serious
  regressions, that doesn't depend on someone remembering to look at the
  web page each week.  An automated email to @ubuntu-devel perhaps?

I was really pleased with the number of folks that stuck with doing the
testing through the whole release.  The important thing with this
testing is not number of people but consistency of a few people doing
the same tests reliably week by week.  That we had 10 people doing the
tests was *great*.

Thanks again,
Bryce