openstack team mailing list archive

[Rohit Karajgi <rohit.karajgi@xxxxxxxxxxxx>]

Hi Soren, 

Surely this is a key aspect that can sometimes get overlooked by us developers. Thanks for bringing this up again. There have been hundreds of bugs that have been filed over the last few months and many clearly indicate that they could have been caught at the unit test level. 
Unit testing is not a hard task (albeit a lazy one sometimes), and there's no debating that the earlier we catch those bugs, the more we get to sleep later on!!

We have some branches (libvirt, network) for unit tests that will greatly increase the coverage numbers and we are still working actively working on this (testing) front. A collective effort from the community means that the 95 or 100% numbers are achievable.

Thanks!
Rohit
(NTT)

-----Original Message-----
From: openstack-bounces+rohit.karajgi=vertex.co.in@xxxxxxxxxxxxxxxxxxx [mailto:openstack-bounces+rohit.karajgi=vertex.co.in@xxxxxxxxxxxxxxxxxxx] On Behalf Of Soren Hansen
Sent: Thursday, August 18, 2011 4:24 PM
To: openstack@xxxxxxxxxxxxxxxxxxx
Subject: [Openstack] Improving test coverage and how you can help out!

At the design summit, we agreed we'd work hard on improving our test coverage. Our friendly neighbourhood butler, Jenkins, keeps track of our test coverage:

    https://jenkins.openstack.org/job/nova-coverage/lastStableBuild/cobertura/

Clearly, there's lots of room for improvement.

I'd like to encourage anyone who cares about testing to take a look at that page, find something, big or small, that lacks test coverage and add tests for it. No method is too small to be tested (the devil's in the details!). Good test coverage is extremely important for maintaining momentum in a project of this level of complexity, so this is a very important effort. I've started filing bugs about missing unit tests. I've only filed a few so far, some are about a few statements that are missing tests, others are about entire modules that hardly have any unit tests at all:

    https://bugs.launchpad.net/nova/+bugs?field.tag=unittests

Feel free to add more bugs like these! It's easier to pick stuff off of a list like that than to try to take in the entire coverage report.

The 100% test coverage we decided (or was it 99%? ot 95%?) at the summit is not going to happen within the next month or two, so I'd like to just see how much we can achieve before the Diablo release.
I'll try to extract some useful numbers every week to see how we're doing.

Who's with me?

--
Soren Hansen        | http://linux2go.dk/ Ubuntu Developer    | http://www.ubuntu.com/ OpenStack Developer | http://www.openstack.org/

_______________________________________________
Mailing list: https://launchpad.net/~openstack
Post to     : openstack@xxxxxxxxxxxxxxxxxxx
Unsubscribe : https://launchpad.net/~openstack
More help   : https://help.launchpad.net/ListHelp