← Back to team overview

openstack team mailing list archive

Re: Fail to reboot VM with Nova + Quantum/OVS

 

https://review.openstack.org/#change,4754

my devstack setup seems to be having problems with latest trunks, so it may
take me a bit longer to test latest.  Are you able to test it locally?
 Two-line change (only one line strictly required).

Dan


On Thu, Mar 1, 2012 at 9:41 AM, Dan Wendlandt <dan@xxxxxxxxxx> wrote:

> Hi Doude,
>
> At a glance, it seems that unplug() being called twice, with the second
> call failing because the first call successfully unplugged the vif already.
>
>
> The unplug() action on the bridge does nothing, so there's no harm in
> calling it twice, which may explain why this is only seen with OVS.
>
> A quick workaround would be to remove the "raise" line at the end of the
> unplug() method for LibvirtOpenVswitchDriver, in which case you will see
> the log message still, but it should not disrupt the reboot (this is
> probably better behavior as well, regardless of the true cause of the bug).
>
>
> We'll look into this.  I created this bug to track discussion on the fix:
> https://bugs.launchpad.net/nova/+bug/944168
>
> Dan
>
>
> On Thu, Mar 1, 2012 at 9:18 AM, Doude <doudouyam@xxxxxxxxx> wrote:
>
>> When I try reboot a VM, the nova-compute fails and the daemon stop.
>> It fails on unpluging VIF interface of the rebooted VM. I use Nova
>> with Quantum and OVS.
>>
>> 2012-03-01 18:12:31 DEBUG nova.rpc.common [-] Making asynchronous call
>> on network ... from (pid=21485) multicall
>> /usr/local/src/nova/nova/rpc/amqp.py:318
>> 2012-03-01 18:12:31 DEBUG nova.rpc.common [-] MSG_ID is
>> b77f0f284af045f396b90fddd16f724e from (pid=21485) multicall
>> /usr/local/src/nova/nova/rpc/amqp.py:321
>> 2012-03-01 18:12:33 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap ovs-vsctl del-port br-int tap9f5ef54c-38 from
>> (pid=21485) execute /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:33 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap ip link delete tap9f5ef54c-38 from (pid=21485)
>> execute /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:34 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap ovs-vsctl del-port br-int tap285c8465-dd from
>> (pid=21485) execute /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:34 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap ip link delete tap285c8465-dd from (pid=21485)
>> execute /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:34 DEBUG nova.utils [-] Attempting to grab semaphore
>> "iptables" for method "apply"... from (pid=21485) inner
>> /usr/local/src/nova/nova/utils.py:824
>> 2012-03-01 18:12:34 DEBUG nova.utils [-] Got semaphore "iptables" for
>> method "apply"... from (pid=21485) inner
>> /usr/local/src/nova/nova/utils.py:828
>> 2012-03-01 18:12:34 DEBUG nova.utils [-] Attempting to grab file lock
>> "iptables" for method "apply"... from (pid=21485) inner
>> /usr/local/src/nova/nova/utils.py:832
>> 2012-03-01 18:12:34 DEBUG nova.utils [-] Got file lock "iptables" for
>> method "apply"... from (pid=21485) inner
>> /usr/local/src/nova/nova/utils.py:839
>> 2012-03-01 18:12:34 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap iptables-save -t filter from (pid=21485) execute
>> /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:35 INFO nova.virt.libvirt.connection [-] [instance:
>> 9300df8d-1a47-40ce-b90e-28f1a84f064d] Instance destroyed successfully.
>> 2012-03-01 18:12:35 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap iptables-restore from (pid=21485) execute
>> /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:35 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap iptables-save -t nat from (pid=21485) execute
>> /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:35 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap iptables-restore from (pid=21485) execute
>> /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:35 DEBUG nova.network.linux_net [-]
>> IPTablesManager.apply completed with success from (pid=21485) apply
>> /usr/local/src/nova/nova/network/linux_net.py:336
>> 2012-03-01 18:12:37 DEBUG nova.utils [-] Running cmd (subprocess):
>> sudo nova-rootwrap ovs-vsctl del-port br-int tap9f5ef54c-38 from
>> (pid=21485) execute /usr/local/src/nova/nova/utils.py:208
>> 2012-03-01 18:12:37 DEBUG nova.utils [-] Result was 1 from (pid=21485)
>> execute /usr/local/src/nova/nova/utils.py:224
>> 2012-03-01 18:12:37 WARNING nova.virt.libvirt.vif [-] Failed while
>> unplugging vif of instance 'instance-00000002'
>>
>> Do you have this problem ?
>>
>> Regards,
>> Doude.
>>
>> _______________________________________________
>> Mailing list: https://launchpad.net/~openstack
>> Post to     : openstack@xxxxxxxxxxxxxxxxxxx
>> Unsubscribe : https://launchpad.net/~openstack
>> More help   : https://help.launchpad.net/ListHelp
>>
>
>
>
> --
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~
> Dan Wendlandt
> Nicira Networks: www.nicira.com
> twitter: danwendlandt
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~
>
>


-- 
~~~~~~~~~~~~~~~~~~~~~~~~~~~
Dan Wendlandt
Nicira Networks: www.nicira.com
twitter: danwendlandt
~~~~~~~~~~~~~~~~~~~~~~~~~~~

References