openstack-qa-team team mailing list archive

[David Kranz <david.kranz@xxxxxxxxxx>]

I just submitted a removal of the skips. Note that there were two user 
role tests that still failed in a way I could not decipher so I filed a 
tempest bug https://bugs.launchpad.net/tempest/+bug/1022990.  
Unfortunately, when the skip script went in with the below checkin 
message, it caused Jenkins to think that the Tempest bugs being skipped 
were actually fixed :-( . I changed the ones I saw back to In Progress 
but it is possible I missed something.

 -David


On 7/8/2012 11:10 PM, Jay Pipes wrote:
> Hey all,
>
> I went ahead and created a script that you can run to see the status of
> any Launchpad bugs that are causing Tempest tests to be skipped:
>
> https://review.openstack.org/#/c/9503
>
> It's output looks like this:
>
> jpipes@uberbox:~/repos/tempest$ python tools/skip_tracker.py
> INFO: Total bug skips found: 52
> INFO: Total unique bugs causing skips: 30
> INFO: Bug # 940500 ( Medium - Fix Released)
> INFO: Bug # 963248 ( Undecided - Invalid)
> INFO: Bug # 966249 ( Undecided - Fix Released)
> INFO: Bug # 987121 ( Medium - Fix Released)
> INFO: Bug # 988920 ( Undecided - Opinion)
> INFO: Bug # 997725 ( Medium - Fix Released)
> INFO: Bug # 999084 ( Medium - Triaged)
> INFO: Bug # 999209 ( Low - Fix Released)
> INFO: Bug # 999219 ( High - Triaged)
> INFO: Bug # 999567 ( Medium - Fix Released)
> INFO: Bug # 999594 ( Medium - In Progress)
> INFO: Bug # 999608 ( Low - Fix Released)
> INFO: Bug #1002892 ( Undecided - Invalid)
> INFO: Bug #1002901 ( Undecided - Invalid)
> INFO: Bug #1002911 ( Undecided - Invalid)
> INFO: Bug #1002918 ( Undecided - Invalid)
> INFO: Bug #1002924 ( Undecided - Incomplete)
> INFO: Bug #1002926 ( Undecided - Invalid)
> INFO: Bug #1002935 ( Undecided - Invalid)
> INFO: Bug #1004007 ( Low - Confirmed)
> INFO: Bug #1004564 ( Low - Confirmed)
> INFO: Bug #1005397 ( Undecided - Invalid)
> INFO: Bug #1005423 ( Low - Triaged)
> INFO: Bug #1006033 ( Undecided - New)
> INFO: Bug #1006725 ( Low - Triaged)
> INFO: Bug #1006857 ( Low - Confirmed)
> INFO: Bug #1006875 ( Low - Confirmed)
> INFO: Bug #1014647 ( Medium - Confirmed)
> INFO: Bug #1014683 ( Undecided - New)
> INFO: Bug #1022411 ( Undecided - In Progress)
> The following bugs have been fixed and the corresponding skips
> should be removed from the test cases:
>
> 940500
> 966249
> 987121
> 997725
> 999209
> 999567
> 999608
>
> If anyone is interested in removing the skips on the test methods for
> any of the bugs listed above -- and/or tracking and updating the bugs
> that are in Invalid, Incomplete, or Opinion status, that would be awesome.
>
> You'll need launchpadlib installed locally to run the script. To do so,
> just:
>
>   pip install launchpadlib
>
> Best,
> -jay