yahoo-eng-team team mailing list archive

[Thierry Carrez <thierry.carrez+lp@xxxxxxxxx>]

** Changed in: nova
       Status: Fix Committed => Fix Released

** Changed in: nova
    Milestone: None => liberty-1

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1456771

Title:
  Failure prepping block device in the gate

Status in OpenStack Compute (Nova):
  Fix Released

Bug description:
  Since May 15th 2015 I sometimes see failures in both check and gate
  pipelines with "Failure prepping block device in the gate" and the
  following common signature:

  http://logstash.openstack.org/#eyJzZWFyY2giOiJcImJsb2NrX2RldmljZV9vYmpba2V5XSA9IGRiX2Jsb2NrX2RldmljZVtrZXldXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjYwNDgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0MzIwNjE5OTMxOTZ9

  req-843cf2f1-4d3a-4c1f-84f6-2c61abec72ac ListServersNegativeTestJSON-690147980 ListServersNegativeTestJSON-786232548] [instance: 76293503-6b94-4b80-8322-83b2ec6c898c] Failure prepping block device
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c] Traceback (most recent call last):
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/opt/stack/new/nova/nova/compute/manager.py", line 2156, in _build_resources
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     block_device_mapping)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/opt/stack/new/nova/nova/compute/manager.py", line 1676, in _default_block_device_names
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     root_bdm.save()
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/opt/stack/new/nova/nova/objects/base.py", line 189, in wrapper
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     self._context, self, fn.__name__, args, kwargs)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/opt/stack/new/nova/nova/conductor/rpcapi.py", line 266, in object_action
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     objmethod=objmethod, args=args, kwargs=kwargs)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 156, in call
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     retry=self.retry)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 90, in _send
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     timeout=timeout, retry=retry)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 350, in send
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     retry=retry)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 341, in _send
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     raise result
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c] TypeError: 'NoneType' object has no attribute '__getitem__'
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c] 
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/opt/stack/new/nova/nova/conductor/manager.py", line 436, in _object_dispatch
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     return getattr(target, method)(*args, **kwargs)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/opt/stack/new/nova/nova/objects/base.py", line 205, in wrapper
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     return fn(self, *args, **kwargs)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/opt/stack/new/nova/nova/objects/block_device.py", line 175, in save
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     self._from_db_object(self._context, self, updated)
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]   File "/opt/stack/new/nova/nova/objects/block_device.py", line 89, in _from_db_object
  2015-05-19 18:46:14.544 15691 TRACE nova.compute.manager [instance: 76293503-6b94-4b80-8322-83b2ec6c898c]     block_device_obj[key] = db_block_device[key]

  Assigning to nova for now as the stack trace is in nova logs.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1456771/+subscriptions