ubuntu-phone team mailing list archive

[Jean-Baptiste Lallement <jean-baptiste.lallement@xxxxxxxxxxxxx>]

Hi Everyone,

Here are some highlights of what the QA Team at Canonical have been 
working on last 2 weeks:

= Automation =
 * Several System level tests released or in review with the 
corresponding helpers:
   - Send an SMS from a contact
   - Send SMS to multiple recipients
   - MTP:
     . Copy music to the phone
     . Copy files from internal storage to the device.
     . Transfer a big file
     . Transfer a big amount of files
   - Test to verify that a all SIM register to the provider.
   - Added a way to use external tests and reuse already existing 
autopilot tests to execute them during regression testing.
   - Any contribution to https://launchpad.net/ubuntu-system-tests welcome!

* Mandatory Demo:
  - Send SMS to multiple recipients:
	https://plus.google.com/+BrendanDonegan/posts/1WzJq7sFxPM
Note that SMS, MMS and call tests use Twilio to send and receive real 
messages and calls.
More videos on Brendan's Google+ page.

 * Change to use OSK for keyboard input instead of virtual input landed 
in OTA5.
 * Proof of Concept to export tests from the test library to a checkbox 
job format for community testing.

 * Power Tests:
   - Added power log graphing, so we can see the actual behavior detail 
instead of just a number.
   - Added the ability to collect and log data on a per-run basis so 
each test run has a lot of details for later investigations.
   - Added on-device measurement and logging during tests, mostly using 
cking's tools. Helps a lot with figuring out what happened when the 
graph shows a power spike or other undesirable behavior.
   - Detailed test results uploaded to
       - http://people.canonical.com/~platform-qa/power-results/?C=M;O=D
   - Document the setup and the deployment of the test environment
   - Lot of improvement to the test harness (maintainability, 
robustness and bug fixing)

= Manual Testing =
 * Last week focus was OTA5 with 23 silos verified, 8 device or custom 
tarballs tested and full regression test run of Krillin.
 * Arale is still in progress.


Thanks,

JB.


--
Jean-Baptiste Lallement
Canonical Services Ltd.
IRC: jibel