ubuntu-touch-coreapps-reviewers team mailing list archive

[Andrew Hayzen <ahayzen@xxxxxxxxx>]

Andrew Hayzen has proposed merging lp:~ahayzen/music-app/add-manual-tests-001 into lp:music-app.

Commit message:
* Add manual tests in checkbox format to repo

Requested reviews:
  Ubuntu Phone Apps Jenkins Bot (ubuntu-phone-apps-jenkins-bot): continuous-integration
  Nicholas Skaggs (nskaggs)
  Music App Developers (music-app-dev)

For more details, see:
https://code.launchpad.net/~ahayzen/music-app/add-manual-tests-001/+merge/272050

* Add manual tests in checkbox format to repo

This has been directly copied from the old manual tests [0]

Note that the durations are all 600 and that any notes/prerequisites I've currently put in the 1.

0 - http://pad.ubuntu.com/MusicAppManualTesting
-- 
Your team Music App Developers is requested to review the proposed merge of lp:~ahayzen/music-app/add-manual-tests-001 into lp:music-app.

=== modified file 'debian/changelog'
--- debian/changelog	2015-09-08 14:18:46 +0000
+++ debian/changelog	2015-09-23 01:02:50 +0000
@@ -3,6 +3,9 @@
   [ Bartosz Kosiorek ]
   *  Reduce size of images (with tinypng.com) to decrease click size and improve performance
 
+  [ Andrew Hayzen ]
+  * Add manual tests in checkbox format to repo
+
  -- Bartosz Kosiorek <gang65@xxxxxxxxxxxxxx>  Tue, 08 Sep 2015 10:08:49 +0200
 
 music-app (2.2ubuntu1) vivid; urgency=medium

=== added directory 'tests/manual'
=== added directory 'tests/manual/music_app'
=== added directory 'tests/manual/music_app/jobs'
=== added file 'tests/manual/music_app/jobs/external.pxu'
--- tests/manual/music_app/jobs/external.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/music_app/jobs/external.pxu	2015-09-23 01:02:50 +0000
@@ -0,0 +1,55 @@
+id: external/uri-handler
+plugin: manual
+_summary: Test music appears in scope and can be launched
+estimated_duration: 600
+_description
+    Test music appears in scope and can be launched
+    1. Switch to music scope
+        Expect to see artists:-  http://people.canonical.com/~alan/screenshots/device-2014-11-17-101609.png
+        Sometimes the search in the scope doesn't seem to load.  I'll recreate and file that later since it's the scope and not the app
+    2. Tap artist
+        Expect to see zoomed in view of artist and below it, some albums:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-101722.png
+    3. Tap album
+        Expect to see a zoomed in view of the album including a list of tracks and button to play in music app:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-101752.png
+    4. Tap "Play in music app"
+        Expect to see music app launch and a track to start playing:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-101818.png
+
+id: external/content-hub
+plugin: manual
+_summary: Test music can be imported via content-hub
+estimated_duration: 600
+_description
+    Test music can be imported via content-hub
+    1. Open the browser, navigate to jamendo.com
+    2. Find a song to download
+    3. Select to "Open with" the Music app
+    4. When the download is finished, select "Open"
+        Expect the music app to open
+        Expect the track to be imported into ~/Music/Imported
+        Expect the current queue to be cleared and replaced by the item(s) imported via content-hub
+        Expect the first song in the import to start playing
+
+id: external/headphones
+plugin: manual
+_summary: Test music plays in headphones
+estimated_duration: 600
+_description
+    Test music plays in headphones
+    1. Play music in app
+    2. Attach headphones
+        Expect music to play through headphones
+    3. Detach headphones
+        Expect the music to pause
+    4. Select play
+        Expect music to play through internal speaker
+
+id: external/infographics
+plugin: manual
+_summary: Test welcome screen stats
+estimated_duration: 600
+_description
+    Test welcome screen stats
+    1. Note: This should be done after the above tests have been completed, and music has been played successfully
+    2. Tap power button to lock screen
+    3. Tap power button to wake phone
+        Expect to see user metrics of songs played (may need to tap-tap this screen to loop round to "songs played today"):- http://people.canonical.com/~alan/screenshots/device-2014-11-17-210613.png

=== added file 'tests/manual/music_app/jobs/library.pxu'
--- tests/manual/music_app/jobs/library.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/music_app/jobs/library.pxu	2015-09-23 01:02:50 +0000
@@ -0,0 +1,124 @@
+id: library/empty-state
+plugin: manual
+_summary: Test to check that the empty state for the library is shown
+estimated_duration: 600
+_description
+    Test to check that the empty state for the library is shown
+    1. Launch music app with no music on device (and no or empty SD card if applicable)
+    2. Expected empty state screen
+        http://people.canonical.com/~alan/screenshots/device-2015-01-23-094554.png
+
+id: library/music-appears
+plugin: manual
+_summary: Test music appearing when on device
+estimated_duration: 600
+_description
+    Test music appearing when on device
+    1. Launch music app
+    2. Unlock device
+    3. On desktop navigate to Devices -> Device name -> Music
+    4. Copy music over USB cable via MTP to Music folder
+        Note: Only MP3 and FLAC files.
+    5. Expect to see music appearing inside the application with appropriate artwork (this may take a while as mediascanner looks for music)
+
+id: library/music-appears-views
+plugin: manual
+_summary: Test music appears appropriately in each view
+estimated_duration: 600
+_description
+    Test music appears appropriately in each view
+    1. Launch music app - expect populated views
+    2. Switch to Artists view
+        Expect to see artists listed in card view:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-101312.png
+    3. Switch to Albums view
+        Expect to see album covers:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-101331.png
+    4. Switch to Genres view
+        Expect to see (multiple if copied) genres with (multiple if appropriate) album cover art:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-101348.png
+    5. Switch to Songs view
+        Expect to see a list of all songs on the device including album art:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-101402.png
+    6. Expect recent to not exist in the tabs
+    7. Switch to Playlists view
+        Expect empty view Playlists:- http://people.canonical.com/~alan/screenshots/device-2015-01-23-094234.png
+
+id: library/music-appears-sd-card
+plugin: manual
+_summary: Test music appearing when on sdcard
+estimated_duration: 600
+_description
+    Test music appearing when on sdcard
+    1. (only applicable on krillin and other devices with sdcard support)
+    2. Unlock device
+        then wait a few moments for the SD card to show up
+    3. On desktop navigate to Devices -> Device name -> SDCARD -> Music
+    4. Copy music over USB cable via MTP to Music folder
+    5. Launch Music app
+    6. Expect music to show up in Songs, Artists and Albums view in Music app
+
+id: library/deletion-of-music
+plugin: manual
+_summary: Test deletion of music
+estimated_duration: 600
+_description
+    Test deletion of music
+    1. Open music app, observe music in Albums view
+    2. Ensure phone is unlocked
+    3. Connect phone via USB
+    4. On desktop navigate to Devices -> Device name -> Music and delete an entire album folder
+        Cannot delete via mtp, will file separately (right click delete in nautilus)
+    5. Expect the album disappears from the music player shortly afterwards
+
+id: library/search-albums
+plugin: manual
+_summary: Test Search Albums
+estimated_duration: 600
+_description
+    Test Search Albums
+    1. Navigate to Albums view
+    2. Press search button in toolbar
+    3. Type a partial search term
+        Expect to see results:- http://people.canonical.com/~alan/screenshots/device-2015-01-12-102618.png
+
+id: library/search-artists
+plugin: manual
+_summary: Test Search Artists
+estimated_duration: 600
+_description
+    Test Search Artists
+    1. Navigate to Artists view
+    2. Press search button in toolbar
+    3. Type a partial search term
+        Expect to see results:- http://people.canonical.com/~alan/screenshots/device-2015-01-12-102729.png
+
+id: library/search-songs
+plugin: manual
+_summary: Test Search Songs
+estimated_duration: 600
+_description
+    Test Search Songs
+    1. Navigate to Songs view
+    2. Press search button in toolbar
+    3. Type a partial search term
+        Expect to see results:- http://people.canonical.com/~alan/screenshots/device-2015-01-12-102836.png
+
+id: library/search-genres
+plugin: manual
+_summary: Test Search Genres
+estimated_duration: 600
+_description
+    Test Search Genres
+    1. Navigate to Genres view
+    2. Press search button in toolbar
+    3. Type a partial search term
+        Expect to see results:- http://people.canonical.com/~alan/screenshots/device-2015-01-12-102927.png
+
+id: library/search-playlists
+plugin: manual
+_summary: Test Search Genres
+estimated_duration: 600
+_description
+    Test Search Genres
+    1. Note: This relies on an earlier test where a playlist was created
+    2. Navigate to Playlist view
+    3. Press search button in toolbar
+    4. Type a partial search term
+        Expect to see results:- http://people.canonical.com/~alan/screenshots/device-2015-01-12-103017.png

=== added file 'tests/manual/music_app/jobs/playlists.pxu'
--- tests/manual/music_app/jobs/playlists.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/music_app/jobs/playlists.pxu	2015-09-23 01:02:50 +0000
@@ -0,0 +1,66 @@
+id: playlists/create-playlists
+plugin: manual
+_summary: Test create playlist
+estimated_duration: 600
+_description
+    Test create playlist
+    1. Open music app
+    2. Navigate to playlist view
+        Expect empty playlist:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-101416.png
+    3. Tap "+" button in top right
+        Expect "New Playlist" dialog:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-204544.png
+    4. Tap in the input field
+        Expect to see the OSK appear:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-205144.png
+    5. Type "Best songs"
+    6. Press Create
+        Expect to see empty playlist:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-205248.png
+
+id: playlists/add-tracks-to-playlist
+plugin: manual
+_summary: Test add tracks to playlist
+estimated_duration: 600
+_description
+    Test add tracks to playlist
+    1. Navigate to Songs view
+    2. Slide left a song
+        Expect to see buttons revealed:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-205354.png
+    3. Tap last icon (add to playlist)
+        Expect to be taken to "Select playlist" view:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-205514.png
+    4. Select previously created playlist "Best songs"
+        Expect to be taken back to previous view:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-205552.png
+    5. Navigate to albums view
+    6. Tap on an album
+        Expect to see the individual album view:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-205713.png
+    7. Long press on a track
+        Expect multi-select boxes and buttons to appear:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-205819.png
+    8. Tap multiple songs
+    9. Tap 'burger' menu in the top right, choose "add to playlist"
+        Expect to be taken to the "Select playlist" view:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-205923.png
+    10. Tap previously create playlist
+         Expect to be taken back to individual album view:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-210010.png
+    11. Navigate to Playlist view
+    12. Tap previously created playlist
+         Expect to see songs previously selected:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-210333.png
+
+id: playlists/remove-playlist
+plugin: manual
+_summary: Test removing playlist
+estimated_duration: 600
+_description
+    Test removing playlist
+    1. Navigate to Playlist view
+    2. Tap previously created playlist
+    3. Tap rubbish bin in top toolbar
+        Expect to get a confirmation prompt:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-210424.png
+    4. Tap 'Remove' button
+        Expect playlist to be removed:- http://people.canonical.com/~alan/screenshots/device-2014-11-17-210520.png
+
+id: playlists/tab-persist
+plugin: manual
+_summary: Test tab index is persists a restart
+estimated_duration: 600
+_description
+    Test tab index is persists a restart
+    1. Start the app and switch to a tab (eg playlists)
+    2. Close the app and restart it
+        Expect the app to start on the same tab

=== added file 'tests/manual/music_app/jobs/queue.pxu'
--- tests/manual/music_app/jobs/queue.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/music_app/jobs/queue.pxu	2015-09-23 01:02:50 +0000
@@ -0,0 +1,36 @@
+id: queue/deletion-music
+plugin: manual
+_summary: Test deletion of music from queue
+estimated_duration: 600
+_description
+    Test deletion of music from queue
+    1. Open music app
+    2. Select an album and play all
+        Expect the album to start playing and that single album to be in the queue
+    3. Delete the entire album from the device
+        Expect the view to be 'popped' back to the Albums view
+        Expect the music to be stopped and the queue to be empty
+
+id: queue/sd-card-remove
+plugin: manual
+_summary: Test removing SD Card during playback
+estimated_duration: 600
+_description
+    Test removing SD Card during playback
+    1. Add some songs to an SD card
+    2. Queue up an album which is on the SD card
+    3. Start playing tracks from the queue
+    4. Remove the SD Card
+        Expect tracks which are no longer accessible should disappear from the queue
+
+id: queue/restart
+plugin: manual
+_summary: Test queue persists a restart
+estimated_duration: 600
+_description
+    Test queue persists a restart
+    1. Start the app
+    2. Add a few albums to the queue
+    3. Take note of the queue and current track
+    4. Restart the app
+        Expect the queue to be restored and the same track to be selected

=== added file 'tests/manual/music_app/jobs/recent.pxu'
--- tests/manual/music_app/jobs/recent.pxu	1970-01-01 00:00:00 +0000
+++ tests/manual/music_app/jobs/recent.pxu	2015-09-23 01:02:50 +0000
@@ -0,0 +1,21 @@
+id: recent/recent-appears
+plugin: manual
+_summary: Test recent tab appears
+estimated_duration: 600
+_description
+    Test recent tab appears
+    1. Goto the album view
+    2. Select an album and play all
+        Expect the recent tab to appear
+    3. Navigate to the recent tab ensure that the album is correct
+
+id: recent/recent-disappears
+plugin: manual
+_summary: Test recent tab disappears
+estimated_duration: 600
+_description
+    Test recent tab disappears
+    1. Ensure that the recent tab is visible and switch to the tab
+    2. Select clear all action
+        Expect to be switched to the albums tab
+        Expect the recent tab to have been removed