yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1383465] Re: [pci-passthrough] nova-compute fails to start

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Nikola Đipanov <ndipanov@xxxxxxxxxx>
Date: Mon, 20 Apr 2015 08:47:39 -0000
Reply-to: Bug 1383465 <1383465@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
** Changed in: nova
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1383465

Title:
  [pci-passthrough] nova-compute fails to start

Status in OpenStack Compute (Nova):
  Fix Released

Bug description:
  Created a guest using nova with a passthrough device, shutdown that
  guest, and disabled nova-compute (openstack-service stop). Went to
  turn things back on, and nova-compute fails to start.

  The trace:
  2014-10-20 16:06:45.734 48553 ERROR nova.openstack.common.threadgroup [-] PCI device request ({'requests': [InstancePCIRequest(alias_name='rook',count=2,is_new=False,request_id=None,spec=[{product_id='10fb',vendor_id='8086'}])], 'code': 500}equests)s failed
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup Traceback (most recent call last):
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/openstack/common/threadgroup.py", line 125, in wait
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     x.wait()
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/openstack/common/threadgroup.py", line 47, in wait
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     return self.thread.wait()
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 173, in wait
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     return self._exit_event.wait()
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/event.py", line 121, in wait
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     return hubs.get_hub().switch()
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/hubs/hub.py", line 293, in switch
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     return self.greenlet.switch()
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/eventlet/greenthread.py", line 212, in main
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     result = function(*args, **kwargs)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/openstack/common/service.py", line 492, in run_service
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     service.start()
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/service.py", line 181, in start
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     self.manager.pre_start_hook()
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 1152, in pre_start_hook
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     self.update_available_resource(nova.context.get_admin_context())
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 5949, in update_available_resource
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     rt.update_available_resource(context)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 332, in update_available_resource
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     return self._update_available_resource(context, resources)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/openstack/common/lockutils.py", line 272, in inner
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     return f(*args, **kwargs)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 349, in _update_available_resource
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     self._update_usage_from_instances(context, resources, instances)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 708, in _update_usage_from_instances
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     self._update_usage_from_instance(context, resources, instance)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 668, in _update_usage_from_instance
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     self.pci_tracker.update_pci_for_instance(context, instance)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/pci/pci_manager.py", line 212, in update_pci_for_instance
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     devs = self._claim_instance(context, instance)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/pci/pci_manager.py", line 157, in _claim_instance
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     devs = self.stats.consume_requests(pci_requests.requests)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.7/site-packages/nova/pci/pci_stats.py", line 156, in consume_requests
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup     raise exception.PciDeviceRequestFailed(requests=pci_requests)
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup PciDeviceRequestFailed: PCI device request ({'requests': [InstancePCIRequest(alias_name='rook',count=2,is_new=False,request_id=None,spec=[{product_id='10fb',vendor_id='8086'}])], 'code': 500}equests)s failed
  2014-10-20 16:06:45.734 48553 TRACE nova.openstack.common.threadgroup

  The resolution was to delete the guest via nova, then virsh undefine
  the guest.  After the nova delete and virsh undefine, I could start
  nova-compute without issue.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1383465/+subscriptions
References

[Bug 1383465] [NEW] [pci-passthrough] nova-compute fails to start
From: Joe Talerico, 2014-10-20