openstack-qa-team team mailing list archive

[David Kranz <david.kranz@xxxxxxxxxx>]

I submitted a fix for the markers problem on the essex stable branch and 
now all the tests (almost) pass using the real essex release. The only 
issue was a non-reproducible failure. I ran this a dozen more times and 
did not see it again :-( . So be on the watch for this.

======================================================================
FAIL: The list of images should contain only images with the provided status
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/cygdrive/c/source/tempest/tempest/tests/test_list_images.py", 
line 98, in test_list_images_filter_by_status
    self.assertTrue(any([i for i in images if i['id'] == self.image2_id]))
AssertionError: False is not True

======================================================================
FAIL: Detailed list of all images should only contain images
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/cygdrive/c/source/tempest/tempest/tests/test_list_images.py", 
line 190, in test_list_images_with_detail_filter_by_status
    self.assertTrue(any([i for i in images if i['id'] == self.image2_id]))
AssertionError: False is not True

----------------------------------------------------------------------
Ran 150 tests in 1118.289s

FAILED (SKIP=22, failures=2)






On 4/13/2012 12:21 PM, Daryl Walleck wrote:
> Speaking to this:
>
> > - ERROR: An update server request for another user's server should fail
> >
> >    seems to be raised because it raises InstanceNotFound and returns a
> >    500 HTTP error code.
> If this is occurring, this is a Nova defect/regression. No AuthZ test should ever be failing with a 500. That means Nova did not handle an internal exception well.
>
> Daryl
>
>
> On Apr 13, 2012, at 4:24 AM, Julien Danjou wrote:
>
> > Hello,
> >
> > We ran tempest against our platform these last days. It is running
> > OpenStack Essex-4.
> >
> > I found a number of issues, some of them I reported as bug reports:
> >
> >   https://bugs.launchpad.net/tempest/+bug/979728
> >   https://bugs.launchpad.net/tempest/+bug/978932
> >   https://bugs.launchpad.net/tempest/+bug/978958
> >
> > Some other tests failed, but it's more than likely than this has been
> > fixed in the final Essex milestone:
> >
> > - ERROR: An update server request for another user's server should fail
> >
> >    seems to be raised because it raises InstanceNotFound and returns a
> >    500 HTTP error code.
> >
> > - ERROR: The list of flavors should start from the provided marker
> >
> >    This seems to be bug #956096
> >
> > - ERROR: test suite for<class 'tempest.tests.test_volumes_list.VolumesTest'>
> >
> >    the tenants used have 0 volume quota authorized
> >
> > - FAIL: The list of images should contain only images with the provided
> >   status
> >
> >    This is likely to be bug #943259
> >
> >
> > Regards,
> > --
> > Julien Danjou
> > // eNovance                      http://enovance.com
> > // ✉ julien.danjou@xxxxxxxxxxxx  ☎ +33 1 49 70 99 81
> >
> > --
> > Mailing list: https://launchpad.net/~openstack-qa-team
> > Post to     : openstack-qa-team@xxxxxxxxxxxxxxxxxxx
> > Unsubscribe : https://launchpad.net/~openstack-qa-team
> > More help   : https://help.launchpad.net/ListHelp