yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #21438
[Bug 1183598] Re: test_spawn_with_network_info fails occasionally
** Changed in: nova
Status: Incomplete => Invalid
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1183598
Title:
test_spawn_with_network_info fails occasionally
Status in OpenStack Compute (Nova):
Invalid
Bug description:
Spotted a random test failure:
http://logs.openstack.org/27456/14/check/gate-nova-
python26/22440/console.html
======================================================================
2013-05-23 21:39:53.005 | FAIL: nova.tests.virt.libvirt.test_libvirt.LibvirtConnTestCase.test_spawn_with_network_info
2013-05-23 21:39:53.005 | tags: worker-3
2013-05-23 21:39:53.005 | ----------------------------------------------------------------------
2013-05-23 21:39:53.005 | Empty attachments:
2013-05-23 21:39:53.005 | stdout
2013-05-23 21:39:53.006 |
2013-05-23 21:39:53.006 | pythonlogging:'': {{{
2013-05-23 21:39:53.006 | Loading network driver 'nova.network.linux_net'
2013-05-23 21:39:53.006 | Creating image
2013-05-23 21:39:53.006 | in fixed duration looping call
2013-05-23 21:39:53.006 | Traceback (most recent call last):
2013-05-23 21:39:53.006 | File "/home/jenkins/workspace/gate-nova-python26/nova/openstack/common/loopingcall.py", line 78, in _inner
2013-05-23 21:39:53.006 | self.f(*self.args, **self.kw)
2013-05-23 21:39:53.006 | File "/home/jenkins/workspace/gate-nova-python26/nova/virt/libvirt/driver.py", line 3229, in wait_for_live_migration
2013-05-23 21:39:53.006 | self.get_info(instance_ref)['state']
2013-05-23 21:39:53.006 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 765, in __call__
2013-05-23 21:39:53.006 | return mock_method(*params, **named_params)
2013-05-23 21:39:53.006 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1002, in __call__
2013-05-23 21:39:53.006 | expected_method = self._VerifyMethodCall()
2013-05-23 21:39:53.006 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1060, in _VerifyMethodCall
2013-05-23 21:39:53.007 | raise UnexpectedMethodCallError(self, expected)
2013-05-23 21:39:53.007 | UnexpectedMethodCallError: Unexpected method call. unexpected:- expected:+
2013-05-23 21:39:53.007 | - get_info.__call__(<nova.db.sqlalchemy.models.Instance object at 0x8bc3bd0>) -> None
2013-05-23 21:39:53.007 | ? ^^^ ^ ^^^
2013-05-23 21:39:53.007 |
2013-05-23 21:39:53.007 | + get_info.__call__(<nova.db.sqlalchemy.models.Instance object at 0xa3b3190>) -> {'state': 1}
2013-05-23 21:39:53.007 | ? ^ ^^^ ^^^^^^ +++++
2013-05-23 21:39:53.007 |
2013-05-23 21:39:53.007 | in fixed duration looping call
2013-05-23 21:39:53.007 | Traceback (most recent call last):
2013-05-23 21:39:53.007 | File "/home/jenkins/workspace/gate-nova-python26/nova/openstack/common/loopingcall.py", line 78, in _inner
2013-05-23 21:39:53.007 | self.f(*self.args, **self.kw)
2013-05-23 21:39:53.007 | File "/home/jenkins/workspace/gate-nova-python26/nova/virt/libvirt/driver.py", line 1539, in _wait_for_boot
2013-05-23 21:39:53.007 | state = self.get_info(instance)['state']
2013-05-23 21:39:53.008 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 765, in __call__
2013-05-23 21:39:53.008 | return mock_method(*params, **named_params)
2013-05-23 21:39:53.008 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1002, in __call__
2013-05-23 21:39:53.008 | expected_method = self._VerifyMethodCall()
2013-05-23 21:39:53.008 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1049, in _VerifyMethodCall
2013-05-23 21:39:53.008 | expected = self._PopNextMethod()
2013-05-23 21:39:53.008 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1035, in _PopNextMethod
2013-05-23 21:39:53.008 | raise UnexpectedMethodCallError(self, None)
2013-05-23 21:39:53.008 | UnexpectedMethodCallError: Unexpected method call get_info.__call__(<nova.db.sqlalchemy.models.Instance object at 0xa3b3190>) -> None
2013-05-23 21:39:53.008 | }}}
2013-05-23 21:39:53.008 |
2013-05-23 21:39:53.008 | stderr: {{{
2013-05-23 21:39:53.008 | Traceback (most recent call last):
2013-05-23 21:39:53.008 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 346, in fire_timers
2013-05-23 21:39:53.008 | timer()
2013-05-23 21:39:53.009 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/eventlet/hubs/timer.py", line 56, in __call__
2013-05-23 21:39:53.009 | cb(*args, **kw)
2013-05-23 21:39:55.267 | File "/home/jenkins/workspace/gate-nova-python26/.tox/libvir: error : internal error could not initialize domain event timer
2013-05-23 21:40:46.688 | py26/lib/python2.6/site-packages/eventlet/event.py", line 165, in _do_send
2013-05-23 21:40:46.688 | waiter.throw(*exc)
2013-05-23 21:40:46.688 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/eventlet/greenthread.py", line 194, in main
2013-05-23 21:40:46.688 | result = function(*args, **kwargs)
2013-05-23 21:40:46.688 | File "/home/jenkins/workspace/gate-nova-python26/nova/virt/libvirt/driver.py", line 3236, in _live_migration
2013-05-23 21:40:46.688 | timer.start(interval=0.5).wait()
2013-05-23 21:40:46.688 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/eventlet/event.py", line 116, in wait
2013-05-23 21:40:46.688 | return hubs.get_hub().switch()
2013-05-23 21:40:46.688 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 187, in switch
2013-05-23 21:40:46.688 | return self.greenlet.switch()
2013-05-23 21:40:46.688 | File "/home/jenkins/workspace/gate-nova-python26/nova/openstack/common/loopingcall.py", line 78, in _inner
2013-05-23 21:40:46.689 | self.f(*self.args, **self.kw)
2013-05-23 21:40:46.689 | File "/home/jenkins/workspace/gate-nova-python26/nova/virt/libvirt/driver.py", line 3229, in wait_for_live_migration
2013-05-23 21:40:46.689 | self.get_info(instance_ref)['state']
2013-05-23 21:40:46.689 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 765, in __call__
2013-05-23 21:40:46.689 | return mock_method(*params, **named_params)
2013-05-23 21:40:46.689 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1002, in __call__
2013-05-23 21:40:46.689 | expected_method = self._VerifyMethodCall()
2013-05-23 21:40:46.689 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1060, in _VerifyMethodCall
2013-05-23 21:40:46.689 | raise UnexpectedMethodCallError(self, expected)
2013-05-23 21:40:46.689 | UnexpectedMethodCallError: Unexpected method call. unexpected:- expected:+
2013-05-23 21:40:46.689 | - get_info.__call__(<nova.db.sqlalchemy.models.Instance object at 0x8bc3bd0>) -> None
2013-05-23 21:40:46.689 | ? ^^^ ^ ^^^
2013-05-23 21:40:46.689 |
2013-05-23 21:40:46.689 | + get_info.__call__(<nova.db.sqlalchemy.models.Instance object at 0xa3b3190>) -> {'state': 1}
2013-05-23 21:40:46.690 | ? ^ ^^^ ^^^^^^ +++++
2013-05-23 21:40:46.690 | }}}
2013-05-23 21:40:46.690 |
2013-05-23 21:40:46.690 | Traceback (most recent call last):
2013-05-23 21:40:46.690 | File "/home/jenkins/workspace/gate-nova-python26/nova/tests/virt/libvirt/test_libvirt.py", line 2638, in test_spawn_with_network_info
2013-05-23 21:40:46.690 | network_info=network_info)
2013-05-23 21:40:46.690 | File "/home/jenkins/workspace/gate-nova-python26/nova/virt/libvirt/driver.py", line 1547, in spawn
2013-05-23 21:40:46.690 | timer.start(interval=0.5).wait()
2013-05-23 21:40:46.690 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/eventlet/event.py", line 116, in wait
2013-05-23 21:40:46.690 | return hubs.get_hub().switch()
2013-05-23 21:40:46.690 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 187, in switch
2013-05-23 21:40:46.690 | return self.greenlet.switch()
2013-05-23 21:40:46.690 | File "/home/jenkins/workspace/gate-nova-python26/nova/openstack/common/loopingcall.py", line 78, in _inner
2013-05-23 21:40:46.690 | self.f(*self.args, **self.kw)
2013-05-23 21:40:46.690 | File "/home/jenkins/workspace/gate-nova-python26/nova/virt/libvirt/driver.py", line 1539, in _wait_for_boot
2013-05-23 21:40:46.691 | state = self.get_info(instance)['state']
2013-05-23 21:40:46.691 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 765, in __call__
2013-05-23 21:40:46.691 | return mock_method(*params, **named_params)
2013-05-23 21:40:46.691 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1002, in __call__
2013-05-23 21:40:46.691 | expected_method = self._VerifyMethodCall()
2013-05-23 21:40:46.691 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1049, in _VerifyMethodCall
2013-05-23 21:40:46.691 | expected = self._PopNextMethod()
2013-05-23 21:40:46.691 | File "/home/jenkins/workspace/gate-nova-python26/.tox/py26/lib/python2.6/site-packages/mox.py", line 1035, in _PopNextMethod
2013-05-23 21:40:46.691 | raise UnexpectedMethodCallError(self, None)
2013-05-23 21:40:46.691 | UnexpectedMethodCallError: Unexpected method call get_info.__call__(<nova.db.sqlalchemy.models.Instance object at 0xa3b3190>) -> None
Looks dubious because context is different than we're expecting.
Perhaps a race of some sort?
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1183598/+subscriptions
