← Back to team overview

openstack team mailing list archive

Re: error while spawning vm

 

>From this error it looks  you don't have brctl in any of the filters in
/etc/nova/*filters:


2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Stdout: '/usr/bin/nova-rootwrap:
Unauthorized command: brctl delif qbr8b7fa98b-60 qvb8b7fa98b-60 (no filter
matched)\n'

What's the output of:

# sudo grep brctl /etc/nova/rootwrap.d/*   # <-- should match mine
/etc/nova/rootwrap.d/compute.filters:# nova/network/linux_net.py: 'brctl',
'addbr', bridge
/etc/nova/rootwrap.d/compute.filters:# nova/network/linux_net.py: 'brctl',
'setfd', bridge, 0
/etc/nova/rootwrap.d/compute.filters:# nova/network/linux_net.py: 'brctl',
'stp', bridge, 'off'
/etc/nova/rootwrap.d/compute.filters:# nova/network/linux_net.py: 'brctl',
'addif', bridge, interface
/etc/nova/rootwrap.d/compute.filters:brctl: CommandFilter, brctl, root
/etc/nova/rootwrap.d/network.filters:# nova/network/linux_net.py: 'brctl',
'addbr', bridge
/etc/nova/rootwrap.d/network.filters:# nova/network/linux_net.py: 'brctl',
'setfd', bridge, 0
/etc/nova/rootwrap.d/network.filters:# nova/network/linux_net.py: 'brctl',
'stp', bridge, 'off'
/etc/nova/rootwrap.d/network.filters:# nova/network/linux_net.py: 'brctl',
'addif', bridge, interface
/etc/nova/rootwrap.d/network.filters:brctl: CommandFilter, brctl, root





On Mon, Apr 29, 2013 at 10:21 AM, Arindam Choudhury <arindam@xxxxxxxx>wrote:

> Hi,
>
> My setup is:
> # nova-manage service list
> Binary           Host                                 Zone
> Status     State Updated_At
> nova-conductor   aopcsos                              internal
> enabled    :-)   2013-04-29 17:10:58
> nova-console     aopcsos                              internal
> enabled    :-)   2013-04-29 17:10:58
> nova-scheduler   aopcsos                              internal
> enabled    :-)   2013-04-29 17:10:58
> nova-cert        aopcso1                              internal
> enabled    :-)   2013-04-29 17:11:03
> nova-compute     aopcso1                              nova
> enabled    :-)   2013-04-29 17:10:55
>
> but when i try to spawn a vm, I always get an error:
>
> 32ae03ff9b44a85426] [instance: b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]
> Starting instance...
> 2013-04-29 19:17:27.433 AUDIT nova.compute.claims
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Attempting claim: memory 512 MB, disk
> 0 GB, VCPUs 1
> 2013-04-29 19:17:27.434 AUDIT nova.compute.claims
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Total Memory: 7984 MB, used: 512 MB
> 2013-04-29 19:17:27.434 AUDIT nova.compute.claims
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Memory limit: 11976 MB, free: 11464 MB
> 2013-04-29 19:17:27.435 AUDIT nova.compute.claims
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Total Disk: 18 GB, used: 0 GB
> 2013-04-29 19:17:27.435 AUDIT nova.compute.claims
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Disk limit not specified, defaulting
> to unlimited
> 2013-04-29 19:17:27.436 AUDIT nova.compute.claims
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Total CPU: 8 VCPUs, used: 0 VCPUs
> 2013-04-29 19:17:27.436 AUDIT nova.compute.claims
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] CPU limit not specified, defaulting
> to unlimited
> 2013-04-29 19:17:27.436 AUDIT nova.compute.claims
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Claim successful
> 2013-04-29 19:17:30.663 INFO nova.virt.libvirt.driver
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Creating image
> 2013-04-29 19:17:30.841 INFO nova.virt.libvirt.firewall
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Called setup_basic_filtering in
> nwfilter
> 2013-04-29 19:17:30.842 INFO nova.virt.libvirt.firewall
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Ensuring static filters
> 2013-04-29 19:17:32.381 ERROR nova.compute.manager
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Instance failed to spawn
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Traceback (most recent call last):
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089, in
> _spawn
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     block_device_info)
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1520,
> in spawn
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     block_device_info)
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2435,
> in _create_domain_and_network
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     domain = self._create_domain(xml,
> instance=instance)
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2396,
> in _create_domain
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]
> domain.createWithFlags(launch_flags)
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in doit
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     result =
> proxy_call(self._autowrap, f, *args, **kwargs)
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
> proxy_call
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     rv = execute(f,*args,**kwargs)
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 76, in tworker
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     rv = meth(*args,**kwargs)
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/libvirt.py", line 650, in createWithFlags
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     if ret == -1: raise libvirtError
> ('virDomainCreateWithFlags() failed', dom=self)
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] libvirtError: Cannot get interface
> MTU on 'qbr8b7fa98b-60': No such device
> 2013-04-29 19:17:32.381 7974 TRACE nova.compute.manager [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]
> 2013-04-29 19:17:32.664 AUDIT nova.compute.manager
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Terminating instance
> 2013-04-29 19:17:33.591 7974 INFO nova.virt.libvirt.driver [-] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Instance destroyed successfully.
> 2013-04-29 19:17:33.640 ERROR nova.virt.libvirt.vif
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Failed while unplugging vif
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Traceback (most recent call last):
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/vif.py", line 442, in
> unplug_ovs_hybrid
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     utils.execute('brctl', 'delif',
> br_name, v1_name, run_as_root=True)
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]   File
> "/usr/lib/python2.7/dist-packages/nova/utils.py", line 239, in execute
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]     cmd=' '.join(cmd))
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] ProcessExecutionError: Unexpected
> error while running command.
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Command: sudo nova-rootwrap
> /etc/nova/rootwrap.conf brctl delif qbr8b7fa98b-60 qvb8b7fa98b-60
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Exit code: 99
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Stdout: '/usr/bin/nova-rootwrap:
> Unauthorized command: brctl delif qbr8b7fa98b-60 qvb8b7fa98b-60 (no filter
> matched)\n'
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Stderr: ''
> 2013-04-29 19:17:33.640 7974 TRACE nova.virt.libvirt.vif [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425]
> 2013-04-29 19:17:33.742 INFO nova.virt.libvirt.driver
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Deleting instance files
> /var/lib/nova/instances/b5317dbd-bd85-4cf7-bbf0-cc653fa8c425
> 2013-04-29 19:17:33.991 ERROR nova.compute.manager
> [req-909247fd-b461-46d6-8b90-bfb0617c7b3a d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Error: ['Traceback (most recent call
> last):\n', '  File
> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 834, in
> _run_instance\n    set_access_ip=set_access_ip)\n', '  File
> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1093, in
> _spawn\n    LOG.exception(_(\'Instance failed to spawn\'),
> instance=instance)\n', '  File "/usr/lib/python2.7/contextlib.py", line 24,
> in __exit__\n    self.gen.next()\n', '  File
> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1089, in
> _spawn\n    block_device_info)\n', '  File
> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 1520,
> in spawn\n    block_device_info)\n', '  File
> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2435,
> in _create_domain_and_network\n    domain = self._create_domain(xml,
> instance=instance)\n', '  File
> "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/driver.py", line 2396,
> in _create_domain\n    domain.createWithFlags(launch_flags)\n', '  File
> "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 187, in
> doit\n    result = proxy_call(self._autowrap, f, *args, **kwargs)\n', '
> File "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 147, in
> proxy_call\n    rv = execute(f,*args,**kwargs)\n', '  File
> "/usr/lib/python2.7/dist-packages/eventlet/tpool.py", line 76, in
> tworker\n    rv = meth(*args,**kwargs)\n', '  File
> "/usr/lib/python2.7/dist-packages/libvirt.py", line 650, in
> createWithFlags\n    if ret == -1: raise libvirtError
> (\'virDomainCreateWithFlags() failed\', dom=self)\n', "libvirtError: Cannot
> get interface MTU on 'qbr8b7fa98b-60': No such device\n"]
> 2013-04-29 19:17:50.171 7974 AUDIT nova.compute.resource_tracker [-]
> Auditing locally available compute resources
> 2013-04-29 19:17:50.393 7974 AUDIT nova.compute.resource_tracker [-] Free
> ram (MB): 6960
> 2013-04-29 19:17:50.393 7974 AUDIT nova.compute.resource_tracker [-] Free
> disk (GB): 18
> 2013-04-29 19:17:50.394 7974 AUDIT nova.compute.resource_tracker [-] Free
> VCPUS: 7
> 2013-04-29 19:17:50.578 7974 INFO nova.compute.resource_tracker [-]
> Compute_service record updated for aopcso1:aopcso1.uab.es
> 2013-04-29 19:17:54.353 AUDIT nova.compute.manager
> [req-967be451-e5f1-40a9-aedf-8328c721d9d0 d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Terminating instance
> 2013-04-29 19:17:55.526 7974 ERROR nova.virt.libvirt.driver [-] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] During wait destroy, instance
> disappeared.
> 2013-04-29 19:17:55.529 INFO nova.virt.libvirt.firewall
> [req-967be451-e5f1-40a9-aedf-8328c721d9d0 d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Attempted to unfilter instance which
> is not filtered
> 2013-04-29 19:17:55.530 INFO nova.virt.libvirt.driver
> [req-967be451-e5f1-40a9-aedf-8328c721d9d0 d73c9e93ac3a40d693b4864b73496fdd
> b6d37008724b4a32ae03ff9b44a85426] [instance:
> b5317dbd-bd85-4cf7-bbf0-cc653fa8c425] Deleting instance files
> /var/lib/nova/instances/b5317dbd-bd85-4cf7-bbf0-cc653fa8c425
>
>
> _______________________________________________
> Mailing list: https://launchpad.net/~openstack
> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~openstack
> More help   : https://help.launchpad.net/ListHelp
>
>

Follow ups

References