ubuntu-sdk-bugs team mailing list archive

[Timo Jyrinki <timo.jyrinki@xxxxxxxxxxxxx>]

** Also affects: ubuntu-ui-toolkit (Ubuntu RTM)
   Importance: Undecided
       Status: New

** Also affects: canonical-devices-system-image
   Importance: Undecided
       Status: New

** Changed in: canonical-devices-system-image
   Importance: Undecided => Critical

** Changed in: canonical-devices-system-image
     Assignee: (unassigned) => Zoltan Balogh (bzoltan)

** Changed in: canonical-devices-system-image
    Milestone: None => 11

-- 
You received this bug notification because you are a member of Ubuntu
SDK bug tracking, which is subscribed to ubuntu-ui-toolkit in Ubuntu.
https://bugs.launchpad.net/bugs/1567286

Title:
  Test runner script gives PASS on segmentation faults

Status in Canonical System Image:
  In Progress
Status in ubuntu-ui-toolkit package in Ubuntu:
  Fix Committed
Status in ubuntu-ui-toolkit package in Ubuntu RTM:
  Fix Committed

Bug description:
  r1920

  Today I mistakingly pushed a new unit test in an MR without "bzr
  add"ing the corresponding QML file.

  CI didn't say anything about it, tests were "PASS" on all architectures, the MR was approved, and it was about to land.  Later in the day I realized I had not pushed the QML file.
  But still, I got all PASS when I should have clearly got FAIL.

  So I manually checked the (PASSing) console log from Jenkins, and found:
  - a QWARN in the test saying that it couldn't find the QML file
  - a segfault in the same test, due to the previous point

  The UITK test suite has a script that runs the tests and checks,
  beside other things, that there were no QWARN issues by tests. That
  check is done by parsing a per-test result .xml that is written at the
  end of each test.

  I think what is happening in this case is that the .xml file is not
  being created at all because of the segfault, and the test runner is
  not detecting that.

  So, potentially, there are other segfaults in other test results that
  have never been caught so far, and could uncover new test failures :)

To manage notifications about this bug go to:
https://bugs.launchpad.net/canonical-devices-system-image/+bug/1567286/+subscriptions