← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1403564] [NEW] nova.tests.unit.conductor.test_conductor._BaseTaskTestCase.test_build_instances_scheduler_failure is racy

 

Public bug reported:

This could be related to bug 1360320 which sounds like a similar
failure, handle_scheduler_error is getting an unexpected instance uuid,
but bug 1360320 was closed simply because we weren't seeing the failure
in the gate anymore.

http://logs.openstack.org/13/140713/2/gate//gate-nova-
python27/6e6b3fb/console.html#_2014-12-15_23_48_28_487

message:"-
function.__call__(<nova.tests.unit.conductor.test_conductor.FakeContext
object at" AND message:"NoValidHost(u'No valid host was found. fake-
reason',)" AND tags:"console" AND build_name:"gate-nova-python27"

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiLSBmdW5jdGlvbi5fX2NhbGxfXygmbHQ7bm92YS50ZXN0cy51bml0LmNvbmR1Y3Rvci50ZXN0X2NvbmR1Y3Rvci5GYWtlQ29udGV4dCBvYmplY3QgYXRcIiBBTkQgbWVzc2FnZTpcIk5vVmFsaWRIb3N0KHUnTm8gdmFsaWQgaG9zdCB3YXMgZm91bmQuIGZha2UtcmVhc29uJywpXCIgQU5EIHRhZ3M6XCJjb25zb2xlXCIgQU5EIGJ1aWxkX25hbWU6XCJnYXRlLW5vdmEtcHl0aG9uMjdcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiY3VzdG9tIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7ImZyb20iOiIyMDE0LTEyLTA4VDE1OjQ3OjEzKzAwOjAwIiwidG8iOiIyMDE0LTEyLTE3VDE1OjQ3OjEzKzAwOjAwIiwidXNlcl9pbnRlcnZhbCI6IjAifSwic3RhbXAiOjE0MTg4MzE3MTMzODJ9

Going back 9 days there are 105 failures in the check and gate queues,
multiple changes, all failures.

With just the gate queue it's 42 hits.

** Affects: nova
     Importance: Medium
         Status: Confirmed


** Tags: gate-failure testing

** Summary changed:

- test_build_instances_scheduler_failure is racy
+ nova.tests.unit.conductor.test_conductor._BaseTaskTestCase.test_build_instances_scheduler_failure is racy

** Changed in: nova
       Status: New => Confirmed

** Changed in: nova
   Importance: Undecided => Medium

** Tags added: gate-failure testing

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1403564

Title:
  nova.tests.unit.conductor.test_conductor._BaseTaskTestCase.test_build_instances_scheduler_failure
  is racy

Status in OpenStack Compute (Nova):
  Confirmed

Bug description:
  This could be related to bug 1360320 which sounds like a similar
  failure, handle_scheduler_error is getting an unexpected instance
  uuid, but bug 1360320 was closed simply because we weren't seeing the
  failure in the gate anymore.

  http://logs.openstack.org/13/140713/2/gate//gate-nova-
  python27/6e6b3fb/console.html#_2014-12-15_23_48_28_487

  message:"-
  function.__call__(<nova.tests.unit.conductor.test_conductor.FakeContext
  object at" AND message:"NoValidHost(u'No valid host was found. fake-
  reason',)" AND tags:"console" AND build_name:"gate-nova-python27"

  http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiLSBmdW5jdGlvbi5fX2NhbGxfXygmbHQ7bm92YS50ZXN0cy51bml0LmNvbmR1Y3Rvci50ZXN0X2NvbmR1Y3Rvci5GYWtlQ29udGV4dCBvYmplY3QgYXRcIiBBTkQgbWVzc2FnZTpcIk5vVmFsaWRIb3N0KHUnTm8gdmFsaWQgaG9zdCB3YXMgZm91bmQuIGZha2UtcmVhc29uJywpXCIgQU5EIHRhZ3M6XCJjb25zb2xlXCIgQU5EIGJ1aWxkX25hbWU6XCJnYXRlLW5vdmEtcHl0aG9uMjdcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiY3VzdG9tIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7ImZyb20iOiIyMDE0LTEyLTA4VDE1OjQ3OjEzKzAwOjAwIiwidG8iOiIyMDE0LTEyLTE3VDE1OjQ3OjEzKzAwOjAwIiwidXNlcl9pbnRlcnZhbCI6IjAifSwic3RhbXAiOjE0MTg4MzE3MTMzODJ9

  Going back 9 days there are 105 failures in the check and gate queues,
  multiple changes, all failures.

  With just the gate queue it's 42 hits.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1403564/+subscriptions


Follow ups

References