xorg-prop-drivers-testers team mailing list archive

[Jeroen van Rijn <jvrnix@xxxxxxxxx>]

On Mon, Apr 19, 2010 at 18:15, Bryce Harrington <bryce@xxxxxxxxxxxxx> wrote:
> * We had several test cases which always failed.  I think we could have
>  communicated these as "expected failures" better, or maybe left them
>  out of the test plan.

Expected failures can be valuable in case the unexpected passes that
go with them are of interest. Building LFS this weekend I came across
a few packages which actually check for unexpected passes.

I would suggest leaving them in there when an unexpected pass can
yield valuable information, and designate the test as an expected
failure; possibly add a caveat that if it does actually pass, 'here's
what info we'd like you to gather'.

Regards,
Jeroen.

-- 
"That's like saying that a squirrel is 48% juicier than an orange -
maybe it's true, but anybody who puts the two in a blender to compare
them is kind of sick." -- Linus Torvalds