ubuntu-audio-dev team mailing list archive

[Alex Wolfson <alex.wolfson@xxxxxxxxxxxxx>]

Hi all,

After conversation with diwic and smagoun I collected the list of audiio
tests that are currently ran. This is edited general list of test that
QA runs. I removed non audio test. 
I believe it makes sense to discuss:

1. What is missing
2. What exists already somewhere else
3. What we can automate / integrate in our test suit.

An issue is certainly broader then just Canonical or Ubuntu

Please take a look at the attached list.

Alex

-- 
Alex Wolfson | OEM Services | Canonical
(w) +1.781.761.9440 | (m) +1.781.632.6152 | Skype: AlexWolfson
10 Maguire Road, Suite 212 | Lexington, MA 02421 USA
alex.wolfson@xxxxxxxxxxxxx www.ubuntu.com
Ubuntu - Linux for human beings


Test Plan
---------
hardware
--------
- hardware/audio

hardware/bluetooth
------------------
- bluetooth-audio
bluetooth-audio
---------------
plugin: manual
name: bluetooth-audio
depends: bluetooth-detect
requires: package.name == 'alsa-utils'
command: arecord -d 5 -D bluetooth -f S16_LE | aplay -D bluetooth -f S16_LE
description:
 Bluetooth audio procedure:
 1.- Enable the bluetooth headset
 2.- Click on the bluetooth icon in the menu bar
 3.- Select 'Setup new device'
 4.- Look for the device in the list and select it
 5.- In the device write the PIN code automatically chosen by the wizard
 6.- The device should pair with the computer
 7.- Select Test to record for five seconds and reproduce in the bluetooth device
 .
 Did all the steps work?
hardware/optical
----------------
- cdrom-audio-playback
cdrom-audio-playback
--------------------
plugin: manual
name: cdrom-audio-playback
depends: cdrom-read
description:
 CD audio playback procedure:
 1.- Insert an audio cd in your optical drive.
 2.- An icon should appear on the desktop.
 3.- Right-click on the icon and select "Open with Rhythmbox".
 4.- Select the CD as the playback source and press play button.
 5.- The music should reproduce.
 6.- Stop music reproduction after some time.
 7.- Right click on the desktop icon and select "Eject Volume".
 8.- The CD should be ejected and the icon removed from the desktop.
 .
 Did all the steps work?

hardware/audio
--------------
- audio/internal-playback
- audio/external-playback
- audio/internal-recording
- audio/external-recording
- audio/external-HDMI-playback

audio/internal-playback
-----------------------
plugin: manual
name: audio/internal-playback
requires:
 device.category == 'AUDIO'
 package.name == 'python-gst0.10'
command:
 gst_pipeline_test -t 2 'audiotestsrc wave=sine freq=512 ! audioconvert ! audioresample ! gconfaudiosink'
description:
 PURPOSE:
     1. Check that internal speakers work correctly
 STEPS:
     1. Make sure that no external headphone is connected
     2. Click the Test button
 VERIFICATION:
     1. Do you hear a sound in the internal speakers?

audio/external-playback
-----------------------
plugin: manual
name: audio/external-playback
requires:
 device.category == 'AUDIO'
 package.name == 'python-gst0.10'
command:
 gst_pipeline_test -t 2 'audiotestsrc wave=sine freq=512 ! audioconvert ! audioresample ! gconfaudiosink'
description:
 PURPOSE:
     1. Check that external headphone connection works correctly
 STEPS:
     1. Insert an external headphone
     2. Click the Test button
 VERIFICATION:
     1. Do you hear a sound in the headphones?

audio/internal-recording
------------------------
plugin: manual
name: audio/internal-recording
requires:
 device.category == 'AUDIO'
 package.name == 'gnome-media'
command: recording.py
description:
 PURPOSE:
     1. Check that onboard microphone works correctly
 STEPS:
     1. Make sure that onboard microphone is being used as the input for sound
     2. Click the Test button
     3. gnome-sound-recorder will be opened
     4. A three seconds clip will be recorded
     5. The recorded clip will be played
 VERIFICATION:
     1. Did you hear your recording?

audio/external-recording
------------------------
plugin: manual
name: audio/external-recording
requires:
 device.category == 'AUDIO'
 package.name == 'gnome-media'
command: recording.py
description:
 PURPOSE:
     1. Check that external microphone connection works correctly
 STEPS:
     1. Make sure that an external microphone is being used as the input for sound
     2. Click the Test button
     3. gnome-sound-recorder will be opened
     4. A three seconds clip will be recorded
     5. The recorded clip will be played
 VERIFICATION:
     1. Did you hear your recording?

audio/external-HDMI-playback
----------------------------
plugin: manual
name: audio/external-HDMI-playback
requires:
 device.category == 'AUDIO'
 package.name == 'python-gst0.10'
command:
 gst_pipeline_test -t 2 'audiotestsrc wave=sine freq=512 ! audioconvert ! audioresample ! gconfaudiosink'
description:
 PURPOSE:
     1. HDMI interface verification
 STEPS:
     1. Plug an external HDMI device with sound
     2. Click on System->Preferences->Sound
     3. Click on Output and Select HDMI
     4. Run sound test
 VERIFICATION:
     1. Did you hear a sound?

keys/volume
-----------
plugin: manual
name: keys/volume
description:
 PURPOSE:
     1. Volume keys verification
 STEPS:
     1. Press the volume keys on the keyboard
     2. A status window should appear and the volume should change
 VERIFICATION:
     1. Do the keys work?

keys/mute
---------
plugin: manual
name: keys/mute
description:
 PURPOSE:
     1. Mute key verification
 STEPS:
     1. Press the mute key on the keyboard
     2. A status window should appear and the volume should mute/unmute when pressed multiple times
 VERIFICATION:
     1. Does the key work?

codecs
------
- codecs/audio

codecs/audio
------------
- codecs/audio/mp3
- codecs/audio/ogg
- codecs/audio/wav
- codecs/audio/wma

codecs/audio/mp3
----------------
plugin: manual
name: codecs/audio/mp3
requires:
 package.name == 'totem'
 package.name == 'oem-qa-media'
command: totem /usr/share/oem-qa-media/audio/sample.mp3
description:
 PURPOSE:
     1. Verify that MPEG-1 Audio layer 3 files (.mp3) can be played
 STEPS:
     1. Select Test to play a sample
 VERIFICATION:
     1. Did the sample play?

codecs/audio/ogg
----------------
plugin: manual
name: codecs/audio/ogg
requires:
 package.name == 'totem'
 package.name == 'oem-qa-media'
command: totem /usr/share/oem-qa-media/audio/sample.ogg
description:
 PURPOSE:
     1. Verify that Ogg file (.ogg) files can be played
 STEPS:
     1. Select Test to play a sample
 VERIFICATION:
     1. Did the sample play?

codecs/audio/wav
----------------
plugin: manual
name: codecs/audio/wav
requires:
 package.name == 'totem'
 package.name == 'oem-qa-media'
command: totem /usr/share/oem-qa-media/audio/sample.wav
description:
 PURPOSE:
     1. Verify that Wave Audio format files (.wav) can be played
 STEPS:
     1. Select Test to play a sample
 VERIFICATION:
     1. Did the sample play?

codecs/audio/wma
----------------
plugin: manual
name: codecs/audio/wma
requires:
 package.name == 'totem'
 package.name == 'oem-qa-media'
command: totem /usr/share/oem-qa-media/audio/sample.wma
description:
 PURPOSE:
     1. Verify that Windows Media Audio file (.wma) files can be played
 STEPS:
     1. Select Test to play a sample
 VERIFICATION:
     1. Did the sample play?