← Back to team overview

touch-packages team mailing list archive

[Bug 1472911] Re: ctest/"make test" reports 100% tests pass even when some fail.

 

** Branch linked: lp:ubuntu/wily-proposed/mir

-- 
You received this bug notification because you are a member of Ubuntu
Touch seeded packages, which is subscribed to mir in Ubuntu.
https://bugs.launchpad.net/bugs/1472911

Title:
  ctest/"make test" reports 100% tests pass even when some fail.

Status in Mir:
  Fix Committed
Status in mir package in Ubuntu:
  Triaged

Bug description:
  ctest or "make test" reports 100% PASS even with failing tests!

  For example:
    1. Break a test by setting an invalid expectation like in MirPixelFormatUtils.alpha_channel_depths
    2. Rebuild
    3. $ make test
          100% tests passed, 0 tests failed out of 9
    4. $ ctest
          100% tests passed, 0 tests failed out of 9
    5. $ umockdev-run -- mir_unit_tests
          [  FAILED  ] 1 test, listed below:
          [  FAILED  ] MirPixelFormatUtils.alpha_channel_depths

To manage notifications about this bug go to:
https://bugs.launchpad.net/mir/+bug/1472911/+subscriptions