kubuntu-council team mailing list archive

[Engineering and Systems Software Research Group - UFAL <mp+468862@xxxxxxxxxxxxxxxxxx>]

Engineering and Systems Software Research Group - UFAL has proposed merging lp:~easy-ufal/ubuntu-manual-tests/improve-1423 into lp:ubuntu-manual-tests.

Requested reviews:
  Ubuntu Testcase Admins (ubuntu-testcase)

For more details, see:
https://code.launchpad.net/~easy-ufal/ubuntu-manual-tests/improve-1423/+merge/468862

Greetings!

The goal of this merge request is to improve test cases by identifying and removing test smells. The term test smell is often used in automated tests but current research has demonstrated that they also exist in natural language test cases. Potential problems they can cause are non-deterministic behavior,  incomplete verification, poor maintainability, and loss of productivity.

In this merge request, we address the Ambiguous Test smell, which indicates an action in a test case not specific enough, leaving room for different interpretations by the testers. 

This test asks for both a .odp file, on the first action, and a .ppt file on the third action. To make it easier for the tester, a precondition is also employed, where a link to an .odp and a .ppt file can be placed.

Also, the third verification wasn't clear enough. So we changed the text to reflect the intent of the test, which is to verify that special characters can be rendered by LibreOffice Impress.

Finally, we believed that the first and the second verifications were switched. Considering that the action “Choose Presentation-Presentation” means to start the slideshow mode, the text “the presentation should run as an on-screen presentation” is more suitable as an verification.

References:

Manoel Aranda, et Al. "A Catalog of Transformations to Remove Test Smells in Natural Language Tests." 28th International Conference on Evaluation and Assessment in Software Engineering (EASE 2024).

Elvys Soares, et Al. "Manual Tests Do Smell! Cataloging and Identifying Natural Language Test Smells." 17th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement (ESEM 2023).

-- 
Your team Ubuntu Testcase Admins is requested to review the proposed merge of lp:~easy-ufal/ubuntu-manual-tests/improve-1423 into lp:ubuntu-manual-tests.

=== modified file 'testcases/packages/1423_LibreOffice'
--- testcases/packages/1423_LibreOffice	2013-08-03 10:34:11 +0000
+++ testcases/packages/1423_LibreOffice	2024-07-05 18:59:55 +0000
@@ -96,13 +96,20 @@
 
 Test-case name: libreoffice/lbc-010
 This test will check that LibreOffice Impress can display special characters
+<em>
+    To perform this test download the following files:
+    <ul>
+        <li>[INSERT LINK TO A .odp FILE WITH SPECIAL CHARACTERS]</li>
+        <li>[INSERT LINK TO A .ppt FILE WITH SPECIAL CHARACTERS]</li>
+    </ul>
+</em>
 <dl>
-    <dt> Open a OpenDocument presentation (.odp) file containing special characters in your language</dt>
+    <dt>Open the OpenDocument presentation (.odp) file downloaded before.</dt>
+        <dd>Special characters in your language should display correctly.</dd>
+    <dt>Choose Presentation-Presentation.</dt>
         <dd>The presentation (OpenDocument and PowerPoint) should run as an on-screen presentation, displaying all the pages with transitions and animations.</dd>
-    <dt> Choose Presentation-Presentation.</dt>
-        <dd>Special characters in your language should display correctly</dd>
-    <dt> Do the same with an MS PowerPoint file.</dt>
-        <dd>Was the content not altered?</dd>
+    <dt>Do the same with the MS PowerPoint file downloaded before.</dt>
+        <dd>Special characters in your language should display correctly.</dd>
 </dl>
 
 Test-case name: libreoffice/lbc-011