← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1578671] Re: Instance bootup failed: libvirtError: Activation of org.freedesktop.machine1 timed out

 

2014.2.3 is an end of life release, can you recreate this on something
that's still supported, preferably mitaka or newton (current master
branch)?

** Changed in: nova
       Status: New => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1578671

Title:
  Instance bootup failed: libvirtError: Activation of
  org.freedesktop.machine1 timed out

Status in OpenStack Compute (nova):
  Invalid

Bug description:
  Nova instance launch is failing on compute nodes with this libvirt
  error.

  Note - The below XML from log shows , VM is launched with multiple
  ports but same is case even when the VM is getting launched with one
  port.

  Nova version - 2014.2.3

  nova-compute - openstack-nova-compute-2014.2.3-29.el7ost.noarch

  2016-05-04 23:26:20.009 13661 DEBUG nova.compute.manager [req-f623be7c-6b63-4311-90ad-36abb1a6691d None] [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] Getting vnc console get_vnc_console /usr/lib/python2.7/site-packages/nova/compute/manager.py:4406
  2016-05-04 23:26:27.452 13661 ERROR nova.virt.libvirt.driver [-] Error launching a defined domain with XML: <domain type='kvm'>
    <name>instance-00001bbc</name>
    <uuid>bf9a2f67-f9cb-41ac-bd8d-5251322bb955</uuid>
    <metadata>
      <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0";>
        <nova:package version="2014.2.3-29.el7ost"/>
        <nova:name>0a158b6dd2e6405e87203e9ef85d4e26.svc.asav.primary</nova:name>
        <nova:creationTime>2016-05-05 06:25:49</nova:creationTime>
        <nova:flavor name="m1.medium">
          <nova:memory>4096</nova:memory>
          <nova:disk>40</nova:disk>
          <nova:swap>0</nova:swap>
          <nova:ephemeral>0</nova:ephemeral>
          <nova:vcpus>2</nova:vcpus>
        </nova:flavor>
        <nova:owner>
          <nova:user uuid="19e278f3c3fa43e3964b057bc73cf7d7">neutron</nova:user>
          <nova:project uuid="9f1663d116f74a01991ad66aaa8756c5">services</nova:project>
        </nova:owner>
        <nova:root type="image" uuid="f4ce918f-7fee-430a-9223-4b424a642ba5"/>
      </nova:instance>
    </metadata>
    <memory unit='KiB'>4194304</memory>
    <currentMemory unit='KiB'>4194304</currentMemory>
    <vcpu placement='static'>2</vcpu>
    <sysinfo type='smbios'>
      <system>
        <entry name='manufacturer'>Red Hat</entry>
        <entry name='product'>OpenStack Compute</entry>
        <entry name='version'>2014.2.3-29.el7ost</entry>
        <entry name='serial'>529cbea6-28a7-4fa7-9229-aae4ad297eb0</entry>
        <entry name='uuid'>bf9a2f67-f9cb-41ac-bd8d-5251322bb955</entry>
      </system>
    </sysinfo>
    <os>
      <type arch='x86_64' machine='pc-i440fx-rhel7.1.0'>hvm</type>
      <boot dev='hd'/>
      <smbios mode='sysinfo'/>
    </os>
    <features>
      <acpi/>
      <apic/>
    </features>
    <cpu mode='host-model'>
      <model fallback='allow'/>
      <topology sockets='2' cores='1' threads='1'/>
    </cpu>
    <clock offset='utc'>
      <timer name='pit' tickpolicy='delay'/>
      <timer name='rtc' tickpolicy='catchup'/>
      <timer name='hpet' present='no'/>
    </clock>
    <on_poweroff>destroy</on_poweroff>
    <on_reboot>restart</on_reboot>
    <on_crash>destroy</on_crash>
    <devices>
      <emulator>/usr/libexec/qemu-kvm</emulator>
      <disk type='file' device='disk'>
        <driver name='qemu' type='qcow2' cache='none'/>
        <source file='/home/novainstance/instances/bf9a2f67-f9cb-41ac-bd8d-5251322bb955/disk'/>
        <target dev='vda' bus='virtio'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>
      </disk>
      <controller type='usb' index='0'>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
      </controller>
      <controller type='pci' index='0' model='pci-root'/>
      <interface type='bridge'>
        <mac address='fa:16:3e:f7:67:ab'/>
        <source bridge='br-int'/>
        <virtualport type='openvswitch'>
          <parameters interfaceid='0d184768-7c57-4031-abde-08f60c5d1a13'/>
        </virtualport>
        <target dev='tap0d184768-7c'/>
        <model type='virtio'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
      </interface>
      <interface type='bridge'>
        <mac address='fa:16:3e:d6:2f:c5'/>
        <source bridge='br-int'/>
        <virtualport type='openvswitch'>
          <parameters interfaceid='493f61c7-5159-4662-bfe1-28709b69c8d8'/>
        </virtualport>
        <target dev='tap493f61c7-51'/>
        <model type='virtio'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
      </interface>
      <interface type='bridge'>
        <mac address='fa:16:3e:db:22:30'/>
        <source bridge='br-int'/>
        <virtualport type='openvswitch'>
          <parameters interfaceid='35a2b1e8-1ddc-4f64-8e59-86ebb4f939e2'/>
        </virtualport>
        <target dev='tap35a2b1e8-1d'/>
        <model type='virtio'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
      </interface>
      <interface type='bridge'>
        <mac address='fa:16:3e:a4:4b:c9'/>
        <source bridge='br-int'/>
        <virtualport type='openvswitch'>
          <parameters interfaceid='0f09948c-6a6a-43b7-8f0a-4c0dab8f1ebf'/>
        </virtualport>
        <target dev='tap0f09948c-6a'/>
        <model type='virtio'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
      </interface>
      <interface type='bridge'>
        <mac address='fa:16:3e:39:67:43'/>
        <source bridge='br-int'/>
        <virtualport type='openvswitch'>
          <parameters interfaceid='eac4a9b3-a4fc-4e61-bd68-f226964119e8'/>
        </virtualport>
        <target dev='tapeac4a9b3-a4'/>
        <model type='virtio'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
      </interface>
      <interface type='bridge'>
        <mac address='fa:16:3e:ae:00:7e'/>
        <source bridge='br-int'/>
        <virtualport type='openvswitch'>
          <parameters interfaceid='9a1d82f7-c655-4573-93ea-4c50d355bb4a'/>
        </virtualport>
        <target dev='tap9a1d82f7-c6'/>
        <model type='virtio'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
      </interface>
      <serial type='file'>
        <source path='/home/novainstance/instances/bf9a2f67-f9cb-41ac-bd8d-5251322bb955/console.log'/>
        <target port='0'/>
      </serial>
      <serial type='pty'>
        <target port='1'/>
      </serial>
      <console type='file'>
        <source path='/home/novainstance/instances/bf9a2f67-f9cb-41ac-bd8d-5251322bb955/console.log'/>
        <target type='serial' port='0'/>
      </console>
      <input type='tablet' bus='usb'/>
      <input type='mouse' bus='ps2'/>
      <input type='keyboard' bus='ps2'/>
      <graphics type='vnc' port='-1' autoport='yes' listen='0.0.0.0' keymap='en-us'>
        <listen type='address' address='0.0.0.0'/>
      </graphics>
      <video>
        <model type='cirrus' vram='16384' heads='1'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
      </video>
      <memballoon model='virtio'>
        <stats period='10'/>
        <address type='pci' domain='0x0000' bus='0x00' slot='0x0a' function='0x0'/>
      </memballoon>
    </devices>
  </domain>

  2016-05-04 23:26:27.453 13661 ERROR nova.compute.manager [-] [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] Instance failed to spawn
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] Traceback (most recent call last):
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2298, in _build_resources
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     yield resources
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2168, in _build_and_run_instance
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     block_device_info=block_device_info)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2714, in spawn
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     block_device_info, disk_info=disk_info)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4673, in _create_domain_and_network
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     power_on=power_on)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4597, in _create_domain
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     LOG.error(err)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     six.reraise(self.type_, self.value, self.tb)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4587, in _create_domain
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     domain.createWithFlags(launch_flags)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 183, in doit
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     result = proxy_call(self._autowrap, f, *args, **kwargs)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 141, in proxy_call
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     rv = execute(f, *args, **kwargs)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 122, in execute
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     six.reraise(c, e, tb)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 80, in tworker
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     rv = meth(*args, **kwargs)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]   File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1059, in createWithFlags
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] libvirtError: Activation of org.freedesktop.machine1 timed out
  2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] 
  2016-05-04 23:26:27.455 13661 AUDIT nova.compute.manager [req-c33bb649-4a7d-4931-9c77-3c67c319e4fc None] [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] Terminating instance

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1578671/+subscriptions


References