ubuntu-phone team mailing list archive

[Alexander Sack <asac@xxxxxxxxxxxxx>]

On Thu, Jun 19, 2014 at 11:52 PM, Paul Larson <paul.larson@xxxxxxxxxxxxx> wrote:
> We'll soon be landing the health-check tests from Colin King in the CI daily
> smoke runs for Ubuntu Touch. These tests will trace processes running on the
> device and provide stats on things like cpu, wakeup events, and I/O
> operations. These are then compared against baseline thresholds to provide
> pass/fail results.  I've been iterating on this for quite a while with a
> stable image, and Colin has been tweaking the thresholds, but we do expect
> there to be some failures at first at least. These will need to be
> individually analyzed.  So the reason for the notice here, is because you
> should soon start to see ~30 new tests show up in the dash board, some of
> which may fail at first. Until things stabilize, these are new tests so they
> probably shouldn't be treated as a regression.


That's amazing. Really looking forward to see those goodies on the
dashboard. I am not sure how easy they will be to read/interpret, but
maybe it would make sense if you and Colin offer 1 or 2 calls
explaining what we see there and how to interpret those results?

Anyway, maybe lets check once we see the actual dashboard entries.

>
> The other thing to be aware of is that they can take a very long time to
> run.  In order to get an accurate picture of what the process is doing over
> time, each process needs to be monitored for at least 5 minutes.  Total run
> time is usually 2-4 hours for just this test suite.  In order to minimize
> the impact, these will be separate runs that take place after the normal
> smoke tests, but the results should feed into the same dashboard so that
> they are more visible.  This way, the long running health check job should
> not impact getting our regular smoke results in a timely fashion.


Sounds perfect to run them independent if they feed into the same
dashboard view!

Thanks!

>
> --
> Mailing list: https://launchpad.net/~ubuntu-phone
> Post to     : ubuntu-phone@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~ubuntu-phone
> More help   : https://help.launchpad.net/ListHelp
>