openstack team mailing list archive

Thread
Date
Re: error while spawning vm

To: Aaron Rosen <arosen@xxxxxxxxxx>, openstack <openstack@xxxxxxxxxxxxxxxxxxx>
From: Arindam Choudhury <arindam@xxxxxxxx>
Date: Mon, 29 Apr 2013 21:04:28 +0200
Importance: Normal
In-reply-to: <CANAD0X_xT5LJRLptM1WcdPDOMOxRWF1ZjjziO-yajUm4Mn_5Qw@mail.gmail.com>
Thanks for your reply.
Surprisingly,  in my /etc/nova/rootwrap.d/, I only have api-metadata.filters. I dont know what went wrong.

Date: Mon, 29 Apr 2013 11:12:46 -0700
Subject: Re: [Openstack] error while spawning vm
From: arosen@xxxxxxxxxx
To: arindam@xxxxxxxx
CC: openstack@xxxxxxxxxxxxxxxxxxx

>From this error it looks  you don't have brctl in any of the filters in /etc/nova/*filters: 

2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Stdout: '/usr/bin/nova-rootwrap: Unauthorized command: brctl delif qbr8b7fa98b-60 qvb8b7fa98b-60 (no filter matched)\n'

What's the output of: 
# sudo grep brctl /etc/nova/rootwrap.d/*   # <-- should match mine/etc/nova/rootwrap.d/compute.filters:# nova/network/linux_net.py: 'brctl', 'addbr', bridge
/etc/nova/rootwrap.d/compute.filters:# nova/network/linux_net.py: 'brctl', 'setfd', bridge, 0/etc/nova/rootwrap.d/compute.filters:# nova/network/linux_net.py: 'brctl', 'stp', bridge, 'off'
/etc/nova/rootwrap.d/compute.filters:# nova/network/linux_net.py: 'brctl', 'addif', bridge, interface/etc/nova/rootwrap.d/compute.filters:brctl: CommandFilter, brctl, root/etc/nova/rootwrap.d/network.filters:# nova/network/linux_net.py: 'brctl', 'addbr', bridge
/etc/nova/rootwrap.d/network.filters:# nova/network/linux_net.py: 'brctl', 'setfd', bridge, 0/etc/nova/rootwrap.d/network.filters:# nova/network/linux_net.py: 'brctl', 'stp', bridge, 'off'
/etc/nova/rootwrap.d/network.filters:# nova/network/linux_net.py: 'brctl', 'addif', bridge, interface/etc/nova/rootwrap.d/network.filters:brctl: CommandFilter, brctl, root





On Mon, Apr 29, 2013 at 10:21 AM, Arindam Choudhury <arindam@xxxxxxxx> wrote:




Hi,

My setup is:
# nova-manage service list
Binary           Host                                 Zone             Status     State Updated_At
nova-conductor   aopcsos                              internal         enabled    :-)   2013-04-29 17:10:58

nova-console     aopcsos                              internal         enabled    :-)   2013-04-29 17:10:58
nova-scheduler   aopcsos                              internal         enabled    :-)   2013-04-29 17:10:58

nova-cert        aopcso1                              internal         enabled    :-)   2013-04-29 17:11:03
nova-compute     aopcso1                              nova             enabled    :-)   2013-04-29 17:10:55


but when i try to spawn a vm, I always get an error:

32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Starting instance...
2013-04-29 19:17:27.433 AUDIT nova.compute.claims [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Attempting claim: memory 512 MB, disk 0 GB, VCPUs 1

2013-04-29 19:17:27.434 AUDIT nova.compute.claims [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Total Memory: 7984 MB, used: 512 MB

2013-04-29 19:17:27.434 AUDIT nova.compute.claims [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Memory limit: 11976 MB, free: 11464 MB

2013-04-29 19:17:27.435 AUDIT nova.compute.claims [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Total Disk: 18 GB, used: 0 GB

2013-04-29 19:17:27.435 AUDIT nova.compute.claims [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Disk limit not specified, defaulting to unlimited

2013-04-29 19:17:27.436 AUDIT nova.compute.claims [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Total CPU: 8 VCPUs, used: 0 VCPUs

2013-04-29 19:17:27.436 AUDIT nova.compute.claims [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] CPU limit not specified, defaulting to unlimited

2013-04-29 19:17:27.436 AUDIT nova.compute.claims [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Claim successful

2013-04-29 19:17:30.663 INFO nova.virt.libvirt.driver [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Creating image

2013-04-29 19:17:30.841 INFO nova.virt.libvirt.firewall [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Called setup_basic_filtering in nwfilter

2013-04-29 19:17:30.842 INFO nova.virt.libvirt.firewall [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Ensuring static filters

2013-04-29 19:17:32.381 ERROR nova.compute.manager [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Instance failed to spawn

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Traceback (most recent call last):
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089, in _spawn

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     block_device_info)
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1520, in spawn

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     block_device_info)
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2435, in _create_domain_and_network

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     domain = self._create_domain(xml, instance=instance)
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2396, in _create_domain

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     domain.createWithFlags(launch_flags)
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in doit

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     result = proxy_call(self._autowrap, f, *args, **kwargs)
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in proxy_call

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     rv = execute(f,*args,**kwargs)
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 76, in tworker

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     rv = meth(*args,**kwargs)
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 650, in createWithFlags

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] libvirtError: Cannot get interface MTU on 'qbr8b7fa98b-60': No such device

2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] 
2013-04-29 19:17:32.664 AUDIT nova.compute.manager [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Terminating instance

2013-04-29 19:17:33.591 7974 INFO nova.virt.libvirt.driver [-] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Instance destroyed successfully.
2013-04-29 19:17:33.640 ERROR nova.virt.libvirt.vif [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Failed while unplugging vif

2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Traceback (most recent call last):
2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/vif.py", line 442, in unplug_ovs_hybrid

2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     utils.execute('brctl', 'delif', br_name, v1_name, run_as_root=True)
2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute

2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     cmd=' '.join(cmd))
2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] ProcessExecutionError: Unexpected error while running command.

2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Command: sudo nova-rootwrap /etc/nova/rootwrap.conf brctl delif qbr8b7fa98b-60 qvb8b7fa98b-60
2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Exit code: 99

2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Stdout: '/usr/bin/nova-rootwrap: Unauthorized command: brctl delif qbr8b7fa98b-60 qvb8b7fa98b-60 (no filter matched)\n'

2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Stderr: ''
2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] 

2013-04-29 19:17:33.742 INFO nova.virt.libvirt.driver [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Deleting instance files /var/lib/nova/instances/b5317dbd-bd85-4cf7-bbf0-cc653fa8c425

2013-04-29 19:17:33.991 ERROR nova.compute.manager [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Error: ['Traceback (most recent call last):\n', '  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834, in _run_instance\n    set_access_ip=set_access_ip)\n', '  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1093, in _spawn\n    LOG.exception(_(\'Instance failed to spawn\'), instance=instance)\n', '  File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__\n    self.gen.next()\n', '  File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089, in _spawn\n    block_device_info)\n', '  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1520, in spawn\n    block_device_info)\n', '  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2435, in _create_domain_and_network\n    domain = self._create_domain(xml, instance=instance)\n', '  File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2396, in _create_domain\n    domain.createWithFlags(launch_flags)\n', '  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in doit\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in proxy_call\n    rv = execute(f,*args,**kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 76, in tworker\n    rv = meth(*args,**kwargs)\n', '  File "/usr/lib/python2.7/dist-packages/libvirt.py", line 650, in createWithFlags\n    if ret == -1: raise libvirtError (\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirtError: Cannot get interface MTU on 'qbr8b7fa98b-60': No such device\n"]

2013-04-29 19:17:50.171 7974 AUDIT nova.compute.resource_tracker [-] Auditing locally available compute resources
2013-04-29 19:17:50.393 7974 AUDIT nova.compute.resource_tracker [-] Free ram (MB): 6960
2013-04-29 19:17:50.393 7974 AUDIT nova.compute.resource_tracker [-] Free disk (GB): 18

2013-04-29 19:17:50.394 7974 AUDIT nova.compute.resource_tracker [-] Free VCPUS: 7
2013-04-29 19:17:50.578 7974 INFO nova.compute.resource_tracker [-] Compute_service record updated for aopcso1:aopcso1.uab.es

2013-04-29 19:17:54.353 AUDIT nova.compute.manager [req-967be451-e5f1-40a9-aedf-8328c721d9d0 d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Terminating instance

2013-04-29 19:17:55.526 7974 ERROR nova.virt.libvirt.driver [-] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] During wait destroy, instance disappeared.
2013-04-29 19:17:55.529 INFO nova.virt.libvirt.firewall [req-967be451-e5f1-40a9-aedf-8328c721d9d0 d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Attempted to unfilter instance which is not filtered

2013-04-29 19:17:55.530 INFO nova.virt.libvirt.driver [req-967be451-e5f1-40a9-aedf-8328c721d9d0 d73c9e93ac3a40d693b4864b73496fdd b6d37008724b4a32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Deleting instance files /var/lib/nova/instances/b5317dbd-bd85-4cf7-bbf0-cc653fa8c425


 		 	   		  

_______________________________________________

Mailing list: https://launchpad.net/~openstack

Post to     : openstack@xxxxxxxxxxxxxxxxxxx

Unsubscribe : https://launchpad.net/~openstack

More help   : https://help.launchpad.net/ListHelp
References

error while spawning vm
From: Arindam Choudhury, 2013-04-29
Re: error while spawning vm
From: Aaron Rosen, 2013-04-29