ubuntu-phone team mailing list archive

[Bill Filler <bill.filler@xxxxxxxxxxxxx>]

On 12/10/2013 12:26 PM, Didier Roche wrote:
> Hey everyone.
>
> Good news first:
> the qmlscene crash and a lot of other bugs while opening the apps are
> now fixed. A consequence is also that the test pass rate jumped above
> 98% as the whole system is way more reliable! Well done everyone. :)
>
> Bad news: image #55 couldn't be promoted because of a regression where
> updated phones to latest image can't install or upgrade click apps (
> https://bugs.launchpad.net/ubuntu/+source/click/+bug/1259253). Colin
> fixed the issue and image #57 with it is now built. Tests are running
> as we speak and we'll be able to take a decision on its promotion with
> those results.
>
> Even if the impressive yearly light festival in my city just ended
> yesterday[1], I'll put some candles tonight on the windows as per
> tradition[2] so that image #57 will finally be THE promoted image :)
>
>
> Now, to move on to the future (assuming we are getting there) on the
> going green story.
> As we are really close to our target of 100% of tests reliably passing
> and there is not anymore any known "can't launch app" blockers, it's
> time to look at getting all flaky tests disabled or fixed. It's
> completely reachable to get that green for Thursday I guess. If you
> can't fix a test that is flaky, the test is useless, so please disable
> it: it's just bringing noise to people trying to release an image.
>
> Here is project by project list. Note that I based it on both images
> 55 and 56 test results.
>
> I count those as blockers for those projects to get a new release to
> Touch until the fix is in or another guilty component is identified:
>
> * ubuntu-ui-toolkit (Zoltan):
> One flaky test (fail on maguro, not on mako)
> http://ci.ubuntu.com/smokeng/trusty/touch/maguro/55:20131209.1:20131203/5355/ubuntu-ui-toolkit-autopilot/559350/
>
> * ubuntu-weather-app (Nicholas):
> One test failing on both platform
> <http://ci.ubuntu.com/smokeng/trusty/touch/maguro/55:20131209.1:20131203/5355/ubuntu-weather-app-autopilot/>http://ci.ubuntu.com/smokeng/trusty/touch/maguro/55:20131209.1:20131203/5355/ubuntu-weather-app-autopilot/559254/
> http://ci.ubuntu.com/smokeng/trusty/touch/mako/55:20131209.1:20131203/5356/ubuntu-weather-app-autopilot/559437/
>
> * ubuntu-file-manager (Nicholas):
> One flaky test on mako
> http://ci.ubuntu.com/smokeng/trusty/touch/mako/55:20131209.1:20131203/5356/ubuntu-filemanager-app-autopilot/559266/
>
> * music-app (Nicholas):
> One flaky test on mako
> http://ci.ubuntu.com/smokeng/trusty/touch/mako/55:20131209.1:20131203/5356/music-app-autopilot/559105/
>
> * calendar-app (Nicholas):
> 4 flaky tests failing on maguro. Maybe will worth a look to see if
> something didn't disturb the environment and it's not protected
> against it.
> http://ci.ubuntu.com/smokeng/trusty/touch/maguro/55:20131209.1:20131203/5355/calendar-app-autopilot/
>
> * terminal-app (Nicholas):
> Enter and backspace broken in terminal:
> https://bugs.launchpad.net/ubuntu-terminal-app/+bug/1257791
>
> * messaging-app (Bill):
> One flaky test on mako. (can be sdk related)
> http://ci.ubuntu.com/smokeng/trusty/touch/mako/55:20131209.1:20131203/5356/messaging-app-autopilot/558958/
>
> * notes-app (Bill)
> One test failing on both mako and maguro:
> http://ci.ubuntu.com/smokeng/trusty/touch/maguro/55:20131209.1:20131203/5355/notes-app-autopilot/558827/
> http://ci.ubuntu.com/smokeng/trusty/touch/mako/55:20131209.1:20131203/5356/notes-app-autopilot/558857/
> 3 flaky tests on mako:
> http://ci.ubuntu.com/smokeng/trusty/touch/mako/56:20131210:20131203/5360/notes-app-autopilot/

Thanks to Ugo and Oliver, notes-app flaky tests were identified and
fixed, hopefully for good :) The changes are in trunk and ready to be
released

>
> * webbrowser-app (Bill)
> 2 flaky tests on maguro only:
> http://ci.ubuntu.com/smokeng/trusty/touch/maguro/56:20131210:20131203/5363/webbrowser-app-autopilot/
>
> * unity8 (Kevin)
> 5 flaky tests on maguro:
> http://ci.ubuntu.com/smokeng/trusty/touch/maguro/55:20131209.1:20131203/5355/unity8-autopilot/558729/
> (1 fail on run 55)
> http://ci.ubuntu.com/smokeng/trusty/touch/maguro/56:20131210:20131203/5363/unity8-autopilot/
> (4 other failures on run 56)
> In addition, remember that Unity 8 has a backlog of pending fixes that
> were waiting for this week. I count them as well as blockers for
> releasing unity8. Meaning:
> - messages in Incoming not always display the correct date and content
> ( https://bugs.launchpad.net/unity8/+bug/1253810)
> - Abort when blancking/unblanking blank screen: old crasher that is
> now really easy to reproduce (
> https://bugs.launchpad.net/ubuntu/+source/unity8/+bug/1258655)
>
> * qtubuntu (Kevin)
> - clocked switched to 24h format (
> https://bugs.launchpad.net/ubuntu/+source/qtubuntu/+bug/1256061) ->
> seems that was unassigned and set back to the qtubuntu pool.
>
> I'll appreciate if all people listed here communicate the progress on
> those issues in this mailing list. That would make a way easier
> coordination.
>
> Thanks to everyone for their cooperation :)
> Didier
>
> [1] http://www.fetedeslumieres.lyon.fr/EN_2013
> [2]
> http://www.fetedeslumieres.lyon.fr/documents/lyon_et_la_lumiere/LumignonsColores.jpg