yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #34109
[Bug 1464366] Re: unit tests fail based on wall clock time
** Changed in: keystone
Status: Fix Committed => Fix Released
** Changed in: keystone
Milestone: None => liberty-1
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Keystone.
https://bugs.launchpad.net/bugs/1464366
Title:
unit tests fail based on wall clock time
Status in OpenStack Identity (Keystone):
Fix Released
Bug description:
We've got a lot of tests that depend on how long the test takes to run. Tests can take a long time just because you have a slow or overloaded system, or maybe you're trying to step through it with the debugger.
The tests that fail generally don't care about the time and aren't
attempting to verify performance, but still require that the test run
quickly enough.
Tests shouldn't depend on the wall clock time, just like they
shouldn't depend on any external factors.
Here's an example of a failing test:
keystone.tests.unit.test_auth.AuthWithRemoteUser.test_scoped_remote_authn
-------------------------------------------------------------------------
Captured traceback:
~~~~~~~~~~~~~~~~~~~
Traceback (most recent call last):
File "keystone/tests/unit/test_auth.py", line 741, in test_scoped_remote_authn
enforce_audit_ids=False)
File "keystone/tests/unit/test_auth.py", line 104, in assertEqualTokens
timeutils.parse_isotime(b['access']['token']['expires']))
File "keystone/tests/unit/core.py", line 521, in assertCloseEnoughForGovernmentWork
self.assertTrue(abs(a - b).seconds <= delta, msg)
File "/home/jenkins/workspace/keystone/.tox/py27/local/lib/python2.7/site-packages/unittest2/case.py", line 678, in assertTrue
raise self.failureException(msg)
AssertionError: False is not true : 2015-06-11 13:34:46+00:00 != 2015-06-11 13:34:50+00:00 within 3 delta
It took 4 seconds rather than 3.
To manage notifications about this bug go to:
https://bugs.launchpad.net/keystone/+bug/1464366/+subscriptions
References