openstack team mailing list archive
-
openstack team
-
Mailing list archive
-
Message #06043
Re: Gating on deployment and integration tests for stable/diablo
Very cool!
Any plans to have a silent (or daily, or on demand) one running against
trunk for all projects?
On 12/8/11 4:12 PM, "James E. Blair" <corvus@xxxxxxxxxxxx> wrote:
>Hi,
>
>A lot of people would like to see us with more commit gating jobs that
>test functionality across the full range of core OpenStack projects.
>We've made some progress in that direction, and I think we can start
>some limited testing by turning on a gating job for the stable/diablo
>branch of several projects.
>
>We have a job on Jenkins that creates a new VM, runs devstack on it, and
>then exercise.sh:
>
>https://jenkins.openstack.org/job/dev-gate-integration-tests-devstack-vm/
>
>It will eventually run the tempest test suite once it's ready. It is
>triggered by gerrit changes to the following projects and branches:
>
>openstack/nova stable/diablo
>openstack/glance stable/diablo
>openstack/keyston stable/diablo
>openstack/openstack-ci master
>openstack/python-novaclient master
>openstack-dev/devstack stable/diablo
>
>A change to any of those projects (on those branches) currently triggers
>this job, in silent mode, which means it runs on the change before it's
>merged into gerrit, but does not vote, and so can not reject the change.
>This configuration has been running for a couple of weeks now.
>
>In general, it usually works, but we have seen a few failures, typically
>either a failure to deploy a VM from the cloud provider or a part of the
>install or setup process that hits the network and encounters a failure.
>We'll continue to work on stabilizing it (volunteers welcome!) In the
>mean time, it's fairly easy to retrigger the test in either jenkins or
>gerrit.
>
>There are still a number of issues involved in turning this on for
>trunk, not only related to stability and determinism, but also to
>coordinating simultaneous changes to multiple projects. However, I
>think this is reasonably stable and workable for the stable/diablo
>branch. It will allow us to get some experience with a cross-project
>integration test gating job without risking slowing down trunk
>development too much. And it just might catch a bug.
>
>So unless anyone objects, I'd like to disable "silent mode" and make
>this an actual gating job for stable/diablo.
>
>-Jim
>
>_______________________________________________
>Mailing list: https://launchpad.net/~openstack
>Post to : openstack@xxxxxxxxxxxxxxxxxxx
>Unsubscribe : https://launchpad.net/~openstack
>More help : https://help.launchpad.net/ListHelp
Follow ups
References