Ok, so I've been testing image 206 on mako, and this is what I've found:
On Mon, Feb 24, 2014 at 9:54 AM, Didier Roche <didrocks@xxxxxxxxxx> wrote:
All results are available at
http://ci.ubuntu.com/smokeng/trusty/touch/mako/206:20140224:20140224. We
have an awesome team of upstream teams/landing team pairing up to examine
all tests failures and tell us if the issue is in the tests themselves, a
regression in the app, or a global platform issue:
- ubuntu_terminal_app (Nicholas & Robert)
- test_circle_menu_shows
I get 100% pass for terminal app.
- ubuntu_weather_app (Nicholas & Robert)
- test_add_location_keyboard
- test_switch_scale
http://paste.ubuntu.com/6988150/ (2 failures on first run)
http://paste.ubuntu.com/6990206/ (5 failures on second run)
- ubuntu_clock_app (Nicholas & Robert)
- test_delete_alarm_must_delete_from_alarm_list
http://paste.ubuntu.com/6990581/ (2 failures, same on both runs)
Tried testing qtorganizer5-eds from silo 2, and then got these results:
http://paste.ubuntu.com/6991026/ (3 failures)
http://paste.ubuntu.com/6991059/ (4 failures)
Weird inconsistent failures, but notably there's a large reduction in
STDERR spew with the updated eds.
- ubuntu_calculator_app (Nicholas & Robert)
- test_three_negative_numbers_multiplication
http://paste.ubuntu.com/6990667/ (1 failure, but not that one)
On second run I got 100% pass. Seems quite flaky.
- music_app (Nicholas & Robert)
- test_add_songs_to_queue_from_songs_tab_and_play
- test_show_albums_sheet
http://paste.ubuntu.com/6990785/ (1 failure but neither of the above)
Second run (muted!!!!) had 100% pass.
So overall it seems most tests are just very flaky; clock-app is the
only one that has two reproducible failures that I can see.
