kubuntu-council team mailing list archive

[Engineering and Systems Software Research Group - UFAL <mp+468866@xxxxxxxxxxxxxxxxxx>]

Engineering and Systems Software Research Group - UFAL has proposed merging lp:~easy-ufal/ubuntu-manual-tests/improve-1561 into lp:ubuntu-manual-tests.

Requested reviews:
  Ubuntu Testcase Admins (ubuntu-testcase)

For more details, see:
https://code.launchpad.net/~easy-ufal/ubuntu-manual-tests/improve-1561/+merge/468866

Greetings!

The goal of this merge request is to improve test cases by identifying and removing test smells. The term test smell is often used in automated tests but current research has demonstrated that they also exist in natural language test cases. Potential problems they can cause are non-deterministic behavior,  incomplete verification, poor maintainability, and loss of productivity.

In this merge request, we address the Ambiguous Test smell, which indicates an action in a test case not specific enough, leaving room for different interpretations by the testers. 

In the third action, the tester is asked to select one of the options in a drop-down list. However, it is quite likely that one of the choices does not result in an expected behavior. For instance, we selected Firefox, as it was one of the options, and the screenshot file did not open. In that situation, some testers could fail the test as the image was not loaded, and others, who have chosen a different application, may approve the test. 

To avoid this potential non-deterministic behavior, we propose to specify the application that the tester should choose. We choose the Ristretto Image Viewer, because it is the default image viewer of the xfce desktop environment.

References:

Manoel Aranda, et Al. "A Catalog of Transformations to Remove Test Smells in Natural Language Tests." 28th International Conference on Evaluation and Assessment in Software Engineering (EASE 2024).

Elvys Soares, et Al. "Manual Tests Do Smell! Cataloging and Identifying Natural Language Test Smells." 17th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM 2023).

-- 
Your team Ubuntu Testcase Admins is requested to review the proposed merge of lp:~easy-ufal/ubuntu-manual-tests/improve-1561 into lp:ubuntu-manual-tests.

=== modified file 'testcases/packages/Xfce/1561_Xfce4 Screenshooter'
--- testcases/packages/Xfce/1561_Xfce4 Screenshooter	2018-06-10 19:56:36 +0000
+++ testcases/packages/Xfce/1561_Xfce4 Screenshooter	2024-07-05 19:03:38 +0000
@@ -34,7 +34,7 @@
         <dd>The drop-down list box should now be enabled and clickable</dd>
     <dt>Click on the drop-down list</dt>
         <dd>A list of available applications should drop down</dd>
-    <dt>Select one of the available applications and click the OK button</dt>
+    <dt>Select "Ristretto Image Viewer" and click the OK button</dt>
         <dd>The screenshot should be opened with the application chosen from the drop-down list</dd>
 </dl>