oem-qa team mailing list archive
-
oem-qa team
-
Mailing list archive
-
Message #00364
[Bug 391254] Re: Refactored script misses some skipped cases
The expression used to detect skipped test cases is:
IS_RESULT_SKIPPED = re.compile(r'^(n/?a|)$', re.I).match
it matches against strings such as: '', 'na', 'NA', 'N/A'
There are two possible reasons for the defect:
- The pattern used didn't match and it has to be fixed: in this case it should clear at first glance since an error will printed to the log stating that result string wasn't matched against any pattern. Please let me know that error, and I will modify the pattern to match for that case.
- The script is filtering out some results that it shouldn't: This is a trickier problem and I'll need to investigate it further. Please let me know the project and build in which the problem is happening and let me know where are some of the skipped test cases that should be present in the statistics. For example, for project Payson and build AZ20081219 the results show 3 skipped test cases.
** Changed in: oem-qa-tools
Importance: Undecided => High
** Changed in: oem-qa-tools
Status: New => Incomplete
** Changed in: oem-qa-tools
Assignee: (unassigned) => Javier Collado (javier.collado)
--
Refactored script misses some skipped cases
https://bugs.launchpad.net/bugs/391254
You received this bug notification because you are a member of OEM
Services QA, which is a direct subscriber.
Status in Project for test tools used by the OEM QA tools: Incomplete
Bug description:
After the refactoring of the reporting scripts, it appears as though the Skipped cases are ignored, as the Skipped value is always shown as 0, even in cases when there are definitely skipped cases.
References