← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #10483

[Bug 1287622] [NEW] fail to launch an instance from a volume snapshot with Gluster libgfapi

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

Description of problem:
While testing around Bug 1020979, I've installed RHEL 6.5 on a volume (size, 50 GB), took a snapshot of the volume and tried to launch an instance with it.

The topology of RHOS is:
- Cloud controller + compute node.
- Stand alone compute node
- Stand alone Cinder with GlusterFS back end.
- Stand alone Glance

The compute logs:

2014-03-03 17:54:49.322 9544 INFO nova.virt.libvirt.firewall [req-c986c6d9-3c36-4bfe-943e-a80d62d15ae1 None None] [instance: 2ec5753e-70bc-428f-8a2c-15cd56a56400] Ensuring static filters
2014-03-03 17:54:50.554 9544 ERROR nova.openstack.common.threadgroup [-] End of file while reading data: Input/output error
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup Traceback (most recent call last):
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/threadgroup.py", line 117, in wait
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     x.wait()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/threadgroup.py", line 49, in wait
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return self.thread.wait()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 168, in wait
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return self._exit_event.wait()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 116, in wait
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return hubs.get_hub().switch()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 187, in switch
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return self.greenlet.switch()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 194, in main
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     result = function(*args, **kwargs)
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/service.py", line 65, in run_service
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     service.start()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/service.py", line 164, in start
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self.manager.pre_start_hook()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 802, in pre_start_hook
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self.update_available_resource(nova.context.get_admin_context())
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 4886, in update_available_resource
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     nodenames = set(self.driver.get_available_nodes())
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/driver.py", line 963, in get_available_nodes
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     stats = self.get_host_stats(refresh=refresh)
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 4432, in get_host_stats
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return self.host_state.get_host_stats(refresh=refresh)
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 386, in host_state
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self._host_state = HostState(self)
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 4832, in __init__
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self.update_status()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 4886, in update_status
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self.driver.get_pci_passthrough_devices()
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3670, in get_pci_passthrough_devices
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     pci_dev = self._get_pcidev_info(name)
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3624, in _get_pcidev_info
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     xmlstr = virtdev.XMLDesc(0)
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib64/python2.6/site-packages/libvirt.py", line 3843, in XMLDesc
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     if ret is None: raise libvirtError ('virNodeDeviceGetXMLDesc() failed')
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup libvirtError: End of file while reading data: Input/output error
2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup 

Version-Release number of selected component (if applicable):
openstack-nova-common-2013.2.2-2.el6ost.noarch
openstack-nova-compute-2013.2.2-2.el6ost.noarch
python-novaclient-2.15.0-2.el6ost.noarch

How reproducible:
100%

Steps to Reproduce:
1. Configure the compute node to run with libgfapi
2. Install an OS on a volume.
3. Take a snapshot of the volume.
4. Launch an instance from the volume's snapshot.

Actual results:
The instance failed to launch.

Expected results:
The instance Active.

Additional info:

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1287622

Title:
  fail to launch an instance from a volume snapshot with Gluster
  libgfapi

Status in OpenStack Compute (Nova):
  New

Bug description:
  Description of problem:
  While testing around Bug 1020979, I've installed RHEL 6.5 on a volume (size, 50 GB), took a snapshot of the volume and tried to launch an instance with it.

  The topology of RHOS is:
  - Cloud controller + compute node.
  - Stand alone compute node
  - Stand alone Cinder with GlusterFS back end.
  - Stand alone Glance

  The compute logs:

  2014-03-03 17:54:49.322 9544 INFO nova.virt.libvirt.firewall [req-c986c6d9-3c36-4bfe-943e-a80d62d15ae1 None None] [instance: 2ec5753e-70bc-428f-8a2c-15cd56a56400] Ensuring static filters
  2014-03-03 17:54:50.554 9544 ERROR nova.openstack.common.threadgroup [-] End of file while reading data: Input/output error
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup Traceback (most recent call last):
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/threadgroup.py", line 117, in wait
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     x.wait()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/threadgroup.py", line 49, in wait
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return self.thread.wait()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 168, in wait
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return self._exit_event.wait()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/event.py", line 116, in wait
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return hubs.get_hub().switch()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/hubs/hub.py", line 187, in switch
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return self.greenlet.switch()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/eventlet/greenthread.py", line 194, in main
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     result = function(*args, **kwargs)
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/openstack/common/service.py", line 65, in run_service
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     service.start()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/service.py", line 164, in start
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self.manager.pre_start_hook()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 802, in pre_start_hook
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self.update_available_resource(nova.context.get_admin_context())
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 4886, in update_available_resource
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     nodenames = set(self.driver.get_available_nodes())
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/driver.py", line 963, in get_available_nodes
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     stats = self.get_host_stats(refresh=refresh)
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 4432, in get_host_stats
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     return self.host_state.get_host_stats(refresh=refresh)
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 386, in host_state
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self._host_state = HostState(self)
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 4832, in __init__
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self.update_status()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 4886, in update_status
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     self.driver.get_pci_passthrough_devices()
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3670, in get_pci_passthrough_devices
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     pci_dev = self._get_pcidev_info(name)
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3624, in _get_pcidev_info
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     xmlstr = virtdev.XMLDesc(0)
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup   File "/usr/lib64/python2.6/site-packages/libvirt.py", line 3843, in XMLDesc
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup     if ret is None: raise libvirtError ('virNodeDeviceGetXMLDesc() failed')
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup libvirtError: End of file while reading data: Input/output error
  2014-03-03 17:54:50.554 9544 TRACE nova.openstack.common.threadgroup 

  Version-Release number of selected component (if applicable):
  openstack-nova-common-2013.2.2-2.el6ost.noarch
  openstack-nova-compute-2013.2.2-2.el6ost.noarch
  python-novaclient-2.15.0-2.el6ost.noarch

  How reproducible:
  100%

  Steps to Reproduce:
  1. Configure the compute node to run with libgfapi
  2. Install an OS on a volume.
  3. Take a snapshot of the volume.
  4. Launch an instance from the volume's snapshot.

  Actual results:
  The instance failed to launch.

  Expected results:
  The instance Active.

  Additional info:

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1287622/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next