yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #50858
[Bug 1578671] Re: Instance bootup failed: libvirtError: Activation of org.freedesktop.machine1 timed out
2014.2.3 is an end of life release, can you recreate this on something
that's still supported, preferably mitaka or newton (current master
branch)?
** Changed in: nova
Status: New => Invalid
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1578671
Title:
Instance bootup failed: libvirtError: Activation of
org.freedesktop.machine1 timed out
Status in OpenStack Compute (nova):
Invalid
Bug description:
Nova instance launch is failing on compute nodes with this libvirt
error.
Note - The below XML from log shows , VM is launched with multiple
ports but same is case even when the VM is getting launched with one
port.
Nova version - 2014.2.3
nova-compute - openstack-nova-compute-2014.2.3-29.el7ost.noarch
2016-05-04 23:26:20.009 13661 DEBUG nova.compute.manager [req-f623be7c-6b63-4311-90ad-36abb1a6691d None] [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] Getting vnc console get_vnc_console /usr/lib/python2.7/site-packages/nova/compute/manager.py:4406
2016-05-04 23:26:27.452 13661 ERROR nova.virt.libvirt.driver [-] Error launching a defined domain with XML: <domain type='kvm'>
<name>instance-00001bbc</name>
<uuid>bf9a2f67-f9cb-41ac-bd8d-5251322bb955</uuid>
<metadata>
<nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0">
<nova:package version="2014.2.3-29.el7ost"/>
<nova:name>0a158b6dd2e6405e87203e9ef85d4e26.svc.asav.primary</nova:name>
<nova:creationTime>2016-05-05 06:25:49</nova:creationTime>
<nova:flavor name="m1.medium">
<nova:memory>4096</nova:memory>
<nova:disk>40</nova:disk>
<nova:swap>0</nova:swap>
<nova:ephemeral>0</nova:ephemeral>
<nova:vcpus>2</nova:vcpus>
</nova:flavor>
<nova:owner>
<nova:user uuid="19e278f3c3fa43e3964b057bc73cf7d7">neutron</nova:user>
<nova:project uuid="9f1663d116f74a01991ad66aaa8756c5">services</nova:project>
</nova:owner>
<nova:root type="image" uuid="f4ce918f-7fee-430a-9223-4b424a642ba5"/>
</nova:instance>
</metadata>
<memory unit='KiB'>4194304</memory>
<currentMemory unit='KiB'>4194304</currentMemory>
<vcpu placement='static'>2</vcpu>
<sysinfo type='smbios'>
<system>
<entry name='manufacturer'>Red Hat</entry>
<entry name='product'>OpenStack Compute</entry>
<entry name='version'>2014.2.3-29.el7ost</entry>
<entry name='serial'>529cbea6-28a7-4fa7-9229-aae4ad297eb0</entry>
<entry name='uuid'>bf9a2f67-f9cb-41ac-bd8d-5251322bb955</entry>
</system>
</sysinfo>
<os>
<type arch='x86_64' machine='pc-i440fx-rhel7.1.0'>hvm</type>
<boot dev='hd'/>
<smbios mode='sysinfo'/>
</os>
<features>
<acpi/>
<apic/>
</features>
<cpu mode='host-model'>
<model fallback='allow'/>
<topology sockets='2' cores='1' threads='1'/>
</cpu>
<clock offset='utc'>
<timer name='pit' tickpolicy='delay'/>
<timer name='rtc' tickpolicy='catchup'/>
<timer name='hpet' present='no'/>
</clock>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>destroy</on_crash>
<devices>
<emulator>/usr/libexec/qemu-kvm</emulator>
<disk type='file' device='disk'>
<driver name='qemu' type='qcow2' cache='none'/>
<source file='/home/novainstance/instances/bf9a2f67-f9cb-41ac-bd8d-5251322bb955/disk'/>
<target dev='vda' bus='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>
</disk>
<controller type='usb' index='0'>
<address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x2'/>
</controller>
<controller type='pci' index='0' model='pci-root'/>
<interface type='bridge'>
<mac address='fa:16:3e:f7:67:ab'/>
<source bridge='br-int'/>
<virtualport type='openvswitch'>
<parameters interfaceid='0d184768-7c57-4031-abde-08f60c5d1a13'/>
</virtualport>
<target dev='tap0d184768-7c'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
</interface>
<interface type='bridge'>
<mac address='fa:16:3e:d6:2f:c5'/>
<source bridge='br-int'/>
<virtualport type='openvswitch'>
<parameters interfaceid='493f61c7-5159-4662-bfe1-28709b69c8d8'/>
</virtualport>
<target dev='tap493f61c7-51'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
</interface>
<interface type='bridge'>
<mac address='fa:16:3e:db:22:30'/>
<source bridge='br-int'/>
<virtualport type='openvswitch'>
<parameters interfaceid='35a2b1e8-1ddc-4f64-8e59-86ebb4f939e2'/>
</virtualport>
<target dev='tap35a2b1e8-1d'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
</interface>
<interface type='bridge'>
<mac address='fa:16:3e:a4:4b:c9'/>
<source bridge='br-int'/>
<virtualport type='openvswitch'>
<parameters interfaceid='0f09948c-6a6a-43b7-8f0a-4c0dab8f1ebf'/>
</virtualport>
<target dev='tap0f09948c-6a'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
</interface>
<interface type='bridge'>
<mac address='fa:16:3e:39:67:43'/>
<source bridge='br-int'/>
<virtualport type='openvswitch'>
<parameters interfaceid='eac4a9b3-a4fc-4e61-bd68-f226964119e8'/>
</virtualport>
<target dev='tapeac4a9b3-a4'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
</interface>
<interface type='bridge'>
<mac address='fa:16:3e:ae:00:7e'/>
<source bridge='br-int'/>
<virtualport type='openvswitch'>
<parameters interfaceid='9a1d82f7-c655-4573-93ea-4c50d355bb4a'/>
</virtualport>
<target dev='tap9a1d82f7-c6'/>
<model type='virtio'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
</interface>
<serial type='file'>
<source path='/home/novainstance/instances/bf9a2f67-f9cb-41ac-bd8d-5251322bb955/console.log'/>
<target port='0'/>
</serial>
<serial type='pty'>
<target port='1'/>
</serial>
<console type='file'>
<source path='/home/novainstance/instances/bf9a2f67-f9cb-41ac-bd8d-5251322bb955/console.log'/>
<target type='serial' port='0'/>
</console>
<input type='tablet' bus='usb'/>
<input type='mouse' bus='ps2'/>
<input type='keyboard' bus='ps2'/>
<graphics type='vnc' port='-1' autoport='yes' listen='0.0.0.0' keymap='en-us'>
<listen type='address' address='0.0.0.0'/>
</graphics>
<video>
<model type='cirrus' vram='16384' heads='1'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
</video>
<memballoon model='virtio'>
<stats period='10'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x0a' function='0x0'/>
</memballoon>
</devices>
</domain>
2016-05-04 23:26:27.453 13661 ERROR nova.compute.manager [-] [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] Instance failed to spawn
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] Traceback (most recent call last):
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2298, in _build_resources
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] yield resources
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 2168, in _build_and_run_instance
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] block_device_info=block_device_info)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 2714, in spawn
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] block_device_info, disk_info=disk_info)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4673, in _create_domain_and_network
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] power_on=power_on)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4597, in _create_domain
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] LOG.error(err)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] six.reraise(self.type_, self.value, self.tb)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/nova/virt/libvirt/driver.py", line 4587, in _create_domain
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] domain.createWithFlags(launch_flags)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 183, in doit
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] result = proxy_call(self._autowrap, f, *args, **kwargs)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 141, in proxy_call
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] rv = execute(f, *args, **kwargs)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 122, in execute
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] six.reraise(c, e, tb)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib/python2.7/site-packages/eventlet/tpool.py", line 80, in tworker
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] rv = meth(*args, **kwargs)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1059, in createWithFlags
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] libvirtError: Activation of org.freedesktop.machine1 timed out
2016-05-04 23:26:27.453 13661 TRACE nova.compute.manager [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955]
2016-05-04 23:26:27.455 13661 AUDIT nova.compute.manager [req-c33bb649-4a7d-4931-9c77-3c67c319e4fc None] [instance: bf9a2f67-f9cb-41ac-bd8d-5251322bb955] Terminating instance
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1578671/+subscriptions
References