ubuntu-phone team mailing list archive

[Robert Park <robert.park@xxxxxxxxxxxxx>]

Ok, so I've been testing image 206 on mako, and this is what I've found:

On Mon, Feb 24, 2014 at 9:54 AM, Didier Roche <didrocks@xxxxxxxxxx> wrote:
> All results are available at
> http://ci.ubuntu.com/smokeng/trusty/touch/mako/206:20140224:20140224. We
> have an awesome team of upstream teams/landing team pairing up to examine
> all tests failures and tell us if the issue is in the tests themselves, a
> regression in the app, or a global platform issue:
>
> - ubuntu_terminal_app (Nicholas & Robert)
>   - test_circle_menu_shows

I get 100% pass for terminal app.

> - ubuntu_weather_app (Nicholas & Robert)
>   - test_add_location_keyboard
>   - test_switch_scale

http://paste.ubuntu.com/6988150/ (2 failures on first run)
http://paste.ubuntu.com/6990206/ (5 failures on second run)

> - ubuntu_clock_app (Nicholas & Robert)
>   - test_delete_alarm_must_delete_from_alarm_list

http://paste.ubuntu.com/6990581/ (2 failures, same on both runs)

Tried testing qtorganizer5-eds from silo 2, and then got these results:

http://paste.ubuntu.com/6991026/ (3 failures)
http://paste.ubuntu.com/6991059/ (4 failures)

Weird inconsistent failures, but notably there's a large reduction in
STDERR spew with the updated eds.

> - ubuntu_calculator_app (Nicholas & Robert)
>   - test_three_negative_numbers_multiplication

http://paste.ubuntu.com/6990667/ (1 failure, but not that one)

On second run I got 100% pass. Seems quite flaky.

> - music_app (Nicholas & Robert)
>   - test_add_songs_to_queue_from_songs_tab_and_play
>   - test_show_albums_sheet

http://paste.ubuntu.com/6990785/ (1 failure but neither of the above)

Second run (muted!!!!) had 100% pass.

So overall it seems most tests are just very flaky; clock-app is the
only one that has two reproducible failures that I can see.