← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1626123] [NEW] Functional tests result depends on way test running

 

Public bug reported:

Description
===========
testtools.run and testtools.run --load-list work differently with nova tests.

Steps to reproduce
==================
amadev@pilgrim:~/m/nova$ source .tox/functional/bin/activate
(functional) amadev@pilgrim:~/m/nova$ python -m testtools.run nova.tests.functional.notification_sample_tests.test_instance.TestInstanceNotificationSample.test_create_delete_server_with_instance_update
...
Ran 1 test in 5.806s
OK
(functional) amadev@pilgrim:~/m/nova$ testr list-tests test_create_delete_server_with_instance_update > /tmp/nova-tests
(functional) amadev@pilgrim:~/m/nova$ python -m testtools.run discover --load-list /tmp/nova-tests
...
Ran 1 test in 4.689s
FAILED (failures=1)

Expected result
===============
Tests shouldn't depent on the method of running.

Environment
===========
upstream master

Logs & Configs
==============
http://xsnippet.org/361996/

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1626123

Title:
  Functional tests result depends on way test running

Status in OpenStack Compute (nova):
  New

Bug description:
  Description
  ===========
  testtools.run and testtools.run --load-list work differently with nova tests.

  Steps to reproduce
  ==================
  amadev@pilgrim:~/m/nova$ source .tox/functional/bin/activate
  (functional) amadev@pilgrim:~/m/nova$ python -m testtools.run nova.tests.functional.notification_sample_tests.test_instance.TestInstanceNotificationSample.test_create_delete_server_with_instance_update
  ...
  Ran 1 test in 5.806s
  OK
  (functional) amadev@pilgrim:~/m/nova$ testr list-tests test_create_delete_server_with_instance_update > /tmp/nova-tests
  (functional) amadev@pilgrim:~/m/nova$ python -m testtools.run discover --load-list /tmp/nova-tests
  ...
  Ran 1 test in 4.689s
  FAILED (failures=1)

  Expected result
  ===============
  Tests shouldn't depent on the method of running.

  Environment
  ===========
  upstream master

  Logs & Configs
  ==============
  http://xsnippet.org/361996/

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1626123/+subscriptions


Follow ups