kubuntu-council team mailing list archive

[Engineering and Systems Software Research Group - UFAL <mp+468861@xxxxxxxxxxxxxxxxxx>]

Engineering and Systems Software Research Group - UFAL has proposed merging lp:~easy-ufal/ubuntu-manual-tests/improve-1416 into lp:ubuntu-manual-tests.

Requested reviews:
  Ubuntu Testcase Admins (ubuntu-testcase)

For more details, see:
https://code.launchpad.net/~easy-ufal/ubuntu-manual-tests/improve-1416/+merge/468861

Greetings!

The goal of this merge request is to improve test cases by identifying and removing test smells. The term test smell is often used in automated tests but current research has demonstrated that they also exist in natural language test cases. Potential problems they can cause are non-deterministic behavior,  incomplete verification, poor maintainability, and loss of productivity.

In this merge request, we address the Ambiguous Test smell, which indicates an action in a test case not specific enough, leaving room for different interpretations by the testers. 

In the second action, the tester is asked to select an image file. The solution is similar to the test above, we relied on a precondition where a link to an downloadable image can be placed.

Additionally, in the second verification, the text asks if the image is displayed “correctly”. We believe that the use of such words can leave room for interpretation, for example, if the image opens in the background but an error pop-up appears. Should the test pass or fail?

To avoid this problem, the text was changed so it says not only that the image should open, but that no other errors or unexpected behavior should occur.

References:

Manoel Aranda, et Al. "A Catalog of Transformations to Remove Test Smells in Natural Language Tests." 28th International Conference on Evaluation and Assessment in Software Engineering (EASE 2024).

Elvys Soares, et Al. "Manual Tests Do Smell! Cataloging and Identifying Natural Language Test Smells." 17th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM 2023).

-- 
Your team Ubuntu Testcase Admins is requested to review the proposed merge of lp:~easy-ufal/ubuntu-manual-tests/improve-1416 into lp:ubuntu-manual-tests.

=== modified file 'testcases/packages/1416_Eye of Gnome'
--- testcases/packages/1416_Eye of Gnome	2013-08-03 10:34:11 +0000
+++ testcases/packages/1416_Eye of Gnome	2024-07-05 18:59:17 +0000
@@ -1,10 +1,16 @@
 Test-case name: eog/eog-001
 This test will check that Eye Of Gnome can display images correctly
+<em>
+    To perform this test download the following files.
+    <ul>
+        <li>[INSERT LINK TO AN IMAGE FILE]</li>
+    </ul>
+</em>
 <dl>
     <dt> Open the dash and launch Image Viewer by pressing the super key, and then entering ‘Image Viewer’</dt>
         <dd>Image Viewer should launch</dd>
-    <dt> Open an image file by selecting file, open and then choosing an image file</dt>
-        <dd>Is the image being displayed correctly?</dd>
+    <dt> Open the previously downloaded image file by selecting file, open and then choosing the image file</dt>
+        <dd>Is the image being displayed without any errors or unexpected behavior?</dd>
 </dl>
 
 Test-case name: eog/eog-002