← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #20735

[Bug 1341967] Re: Instance failed to create in openstack Icehouse with xen

  Thread Previous • Date Previous • • Thread Next 
libvirt xen is largely untested, it is considered a class C supported
hypervisor.

** Summary changed:

- Instance failed to create in openstack Icehouse with xen
+ Instance failed to create in openstack Icehouse with libvirt xen

** Summary changed:

- Instance failed to create in openstack Icehouse with libvirt xen
+ Windows 7 64bit instance failed to create in openstack Icehouse with libvirt xen

** Changed in: nova
   Importance: Undecided => Low

** Changed in: nova
       Status: New => Opinion

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1341967

Title:
  Windows 7 64bit instance failed to create in openstack Icehouse with
  libvirt xen

Status in OpenStack Compute (Nova):
  Opinion

Bug description:
  Hi
  openstack Icehouse with Xen4 on Cent OS6.5.
  Toolstack:Libvirt

  We have installed one controller with compute1  + compute2.

  While creating instance it failed with error "  Instance failed to
  spawn"

  Please find attached logs of nova compute and Scheduler.

  Nova.conf

  rpc_backend = qpid
  qpid_hostname = 192.168.1.6
  my_ip = 192.168.1.6
  vncserver_listen = 192.168.1.6
  vncserver_proxyclient_address = 192.168.1.6
  vnc_enabled=True
  libvirt_ovs_bridge=br-int
  libvirt_vif_type=ethernet
  libvirt_use_virtio_for_bridges=True
  libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtGenericVIFDriver
  rpc_backend = qpid
  qpid_hostname = 192.168.1.6
  my_ip = 192.168.1.6
  vncserver_listen = 192.168.1.6
  vncserver_proxyclient_address = 192.168.1.6
  vnc_enabled=True
  libvirt_ovs_bridge=br-int
  libvirt_vif_type=ethernet
  libvirt_use_virtio_for_bridges=True
  libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtGenericVIFDriver
  instance_usage_audit=True
  instance_usage_audit_period=hour
  notification_driver=nova.openstack.common.notifier.rpc_notifier
  compute_driver = libvirt.LibvirtDriver
  instance_usage_audit=True
  instance_usage_audit_period=hour
  notification_driver=nova.openstack.common.notifier.rpc_notifier
  compute_driver = libvirt.LibvirtDriver

  Nova Scheduler log:

  2014-07-14 18:47:58.261 4152 WARNING nova.scheduler.filters.compute_filter [req-7c3ad960-9b93-4d4e-a43e-090d5c08d6ba 818ef8e8816b426b95d3708bc7949fc1 ea31329396294185bfba564a02cc50d0] (compute1, compute1) ram:29607 disk:21504 io_ops:1 instances:2 has not been heard from in a while
  2014-07-14 18:48:01.614 4152 ERROR nova.scheduler.filter_scheduler [req-7c3ad960-9b93-4d4e-a43e-090d5c08d6ba 818ef8e8816b426b95d3708bc7949fc1 ea31329396294185bfba564a02cc50d0] [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77] Error from last host: controller (node controller): [u'Traceback (most recent call last):\n', u'  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1305, in _build_instance\n    set_access_ip=set_access_ip)\n', u'  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 393, in decorated_function\n    return function(self, context, *args, **kwargs)\n', u'  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1717, in _spawn\n    LOG.exception(_(\'Instance failed to spawn\'), instance=instance)\n', u'  File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n    six.reraise(self.type_, self.value, self.tb)\n', u'  File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1714, in _spawn\n    block_device_info)\n', u'  File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 2265, in spawn\n    block_device_info)\n', u'  File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3656, in _create_domain_and_network\n    power_on=power_on)\n', u'  File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3559, in _create_domain\n    domain.XMLDesc(0))\n', u'  File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__\n    six.reraise(self.type_, self.value, self.tb)\n', u'  File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3554, in _create_domain\n    domain.createWithFlags(launch_flags)\n', u'  File "/usr/lib/python2.6/site-packages/eventlet/tpool.py", line 179, in doit\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\n', u'  File "/usr/lib/python2.6/site-packages/eventlet/tpool.py", line 139, in proxy_call\n    rv = execute(f,*args,**kwargs)\n', u'  File "/usr/lib/python2.6/site-packages/eventlet/tpool.py", line 77, in tworker\n    rv = meth(*args,**kwargs)\n', u'  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 708, in createWithFlags\n    if ret == -1: raise libvirtError (\'virDomainCreateWithFlags() failed\', dom=self)\n', u'libvirtError: POST operation failed: xend_post: error from xen daemon: (xend.err "(\'create\', \'-aqcow2:/var/lib/nova/instances/dade5a94-0d65-4bcb-a60d-27fd334b5b77/disk\') failed (512  )")\n']
  2014-07-14 18:48:01.617 4152 WARNING nova.scheduler.filters.compute_filter [req-7c3ad960-9b93-4d4e-a43e-090d5c08d6ba 818ef8e8816b426b95d3708bc7949fc1 ea31329396294185bfba564a02cc50d0] (compute1, compute1) ram:29607 disk:21504 io_ops:1 instances:2 has not been heard from in a while
  2014-07-14 18:48:01.617 4152 WARNING nova.scheduler.driver [req-7c3ad960-9b93-4d4e-a43e-090d5c08d6ba 818ef8e8816b426b95d3708bc7949fc1 ea31329396294185bfba564a02cc50d0] [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77] Setting instance to ERROR state.

  
  nova Compute log:

  2014-07-14 18:47:58.803 4088 INFO oslo.messaging._drivers.impl_qpid [-] Connected to AMQP server on 192.168.1.6:5672
  2014-07-14 18:48:00.939 4088 ERROR nova.virt.libvirt.driver [req-7c3ad960-9b93-4d4e-a43e-090d5c08d6ba 818ef8e8816b426b95d3708bc7949fc1 ea31329396294185bfba564a02cc50d0] An error occurred while trying to launch a defined domain with xml: <domain type='xen'>
    <name>instance-0000000a</name>
    <uuid>dade5a94-0d65-4bcb-a60d-27fd334b5b77</uuid>
    <memory unit='KiB'>2097152</memory>
    <currentMemory unit='KiB'>2097152</currentMemory>
    <vcpu placement='static'>1</vcpu>
    <bootloader></bootloader>
    <os>
      <type>linux</type>
    </os>
    <clock offset='utc' adjustment='reset'/>
    <on_poweroff>destroy</on_poweroff>
    <on_reboot>restart</on_reboot>
    <on_crash>destroy</on_crash>
    <devices>
      <emulator>/usr/lib/xen/bin/qemu-dm</emulator>
      <disk type='file' device='disk'>
        <driver name='tap2' type='qcow2'/>
        <source file='/var/lib/nova/instances/dade5a94-0d65-4bcb-a60d-27fd334b5b77/disk'/>
        <target dev='sda' bus='scsi'/>
      </disk>
      <console type='pty'>
        <target type='xen' port='0'/>
      </console>
      <input type='mouse' bus='xen'/>
      <graphics type='vnc' port='-1' autoport='yes' listen='192.168.1.6' keymap='en-us'>
        <listen type='address' address='192.168.1.6'/>
      </graphics>

  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     domain.XMLDesc(0))
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib/python2.6/site-packages/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     six.reraise(self.type_, self.value, self.tb)
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib/python2.6/site-packages/nova/virt/libvirt/driver.py", line 3554, in _create_domain
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     domain.createWithFlags(launch_flags)
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib/python2.6/site-packages/eventlet/tpool.py", line 179, in doit
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     result = proxy_call(self._autowrap, f, *args, **kwargs)
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib/python2.6/site-packages/eventlet/tpool.py", line 139, in proxy_call
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     rv = execute(f,*args,**kwargs)
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib/python2.6/site-packages/eventlet/tpool.py", line 77, in tworker
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     rv = meth(*args,**kwargs)
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib64/python2.6/site-packages/libvirt.py", line 708, in createWithFlags
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77] libvirtError: POST operation failed: xend_post: error from xen daemon: (xend.err "('create', '-aqcow2:/var/lib/nova/instances/dade5a94-0d65-4bcb-a60d-27fd334b5b77/disk') failed (512  )")
  2014-07-14 18:48:00.940 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]
  2014-07-14 18:48:01.570 4088 ERROR nova.compute.manager [req-7c3ad960-9b93-4d4e-a43e-090d5c08d6ba 818ef8e8816b426b95d3708bc7949fc1 ea31329396294185bfba564a02cc50d0] [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77] Error: POST operation failed: xend_post: error from xen daemon: (xend.err "('create', '-aqcow2:/var/lib/nova/instances/dade5a94-0d65-4bcb-a60d-27fd334b5b77/disk') failed (512  )")
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77] Traceback (most recent call last):
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1305, in _build_instance
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     set_access_ip=set_access_ip)
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 393, in decorated_function
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     return function(self, context, *args, **kwargs)
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]   File "/usr/lib/python2.6/site-packages/nova/compute/manager.py", line 1717, in _spawn
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     LOG.exception(_('Instance failed to spawn'), instance=instance)
  @                     
  , in createWithFlags
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77] libvirtError: POST operation failed: xend_post: error from xen daemon: (xend.err "('create', '-aqcow2:/var/lib/nova/instances/dade5a94-0d65-4bcb-a60d-27fd334b5b77/disk') failed (512  )")
  2014-07-14 18:48:01.570 4088 TRACE nova.compute.manager [instance: dade5a94-0d65-4bcb-a60d-27fd334b5b77]
  2014-07-14 18:48:22.500 4088 WARNING nova.virt.libvirt.driver [-] Periodic task is updating the host stat, it is trying to get disk VM1, but disk file was removed by concurrent operations such as resize.
  2014-07-14 18:49:22.868 4088 WARNING nova.virt.libvirt.driver [-] Periodic task is updating the host stat, it is trying to get disk VM1, but disk file was removed by concurrent operations such as resize.
  2014-07-14 18:50:22.089 4088 WARNING nova.virt.libvirt.driver [-] Periodic task is updating the host stat, it is trying to get disk VM1, but disk file was removed by concurrent operations such as resize.
  2014-07-14 18:50:23.153 4088 WARNING nova.virt.libvirt.driver [-] Periodic task is updating the host stat, it is trying to get disk VM1, but disk file was removed by concurrent operations such as resize.
  2014-07

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1341967/+subscriptions

References

  Thread Previous • Date Previous • • Thread Next