yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1325126] Re: Failed to deallocate networks: unable to execute ovs-vsctl

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Launchpad Bug Tracker <1325126@xxxxxxxxxxxxxxxxxx>
Date: Fri, 01 Aug 2014 04:17:15 -0000
Reply-to: Bug 1325126 <1325126@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
[Expired for neutron because there has been no activity for 60 days.]

** Changed in: neutron
       Status: Incomplete => Expired

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1325126

Title:
  Failed to deallocate networks: unable to execute ovs-vsctl

Status in OpenStack Neutron (virtual network service):
  Expired

Bug description:
  Seeing a new tempest failure where it appears that networks can't be
  deallocated due to ovs_lib failure?

  Full logs @ http://logs.openstack.org/41/96941/1/check/check-grenade-
  dsvm/6008ff3/

  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 ERROR nova.compute.manager [req-62e5ac1d-7cb1-465f-810f-f3e615f99879 InstanceRunTest-1076740366 InstanceRunTest-109278700] [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a] Failed to deallocate networks
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a] Traceback (most recent call last):
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/compute/manager.py", line 2081, in _cleanup_allocated_networks
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     instance.save()
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/objects/base.py", line 178, in wrapper
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     ctxt, self, fn.__name__, args, kwargs)
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/conductor/rpcapi.py", line 360, in object_action
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     objmethod=objmethod, args=args, kwargs=kwargs)
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/rpc/client.py", line 150, in call
  2014-05-30 23:03:16.220 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     wait_for_reply=True, timeout=timeout)
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/transport.py", line 89, in _send
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     timeout=timeout)
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 386, in send
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     return self._send(target, ctxt, message, wait_for_reply, timeout)
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/usr/local/lib/python2.7/dist-packages/oslo/messaging/_drivers/amqpdriver.py", line 379, in _send
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     raise result
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a] InstanceNotFound_Remote: Instance a66809a0-c372-4e52-8ff9-100c7825fb3a could not be found.
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a] Traceback (most recent call last):
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/conductor/manager.py", line 602, in _object_dispatch
  2014-05-30 23:03:16.221 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     return getattr(target, method)(context, *args, **kwargs)
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/objects/base.py", line 187, in wrapper
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     return fn(self, ctxt, *args, **kwargs)
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/objects/instance.py", line 473, in save
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     columns_to_join=_expected_cols(expected_attrs))
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/db/api.py", line 780, in instance_update_and_get_original
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     columns_to_join=columns_to_join)
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.222 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 164, in wrapper
  2014-05-30 23:03:16.223 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     return f(*args, **kwargs)
  2014-05-30 23:03:16.223 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.223 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 2226, in instance_update_and_get_original
  2014-05-30 23:03:16.223 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     columns_to_join=columns_to_join)
  2014-05-30 23:03:16.223 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.223 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 2264, in _instance_update
  2014-05-30 23:03:16.223 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     columns_to_join=columns_to_join)
  2014-05-30 23:03:16.223 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.224 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]   File "/opt/stack/new/nova/nova/db/sqlalchemy/api.py", line 1714, in _instance_get_by_uuid
  2014-05-30 23:03:16.224 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]     raise exception.InstanceNotFound(instance_id=uuid)
  2014-05-30 23:03:16.224 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.224 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a] InstanceNotFound: Instance a66809a0-c372-4e52-8ff9-100c7825fb3a could not be found.
  2014-05-30 23:03:16.224 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.224 | *** Not Whitelisted *** 2014-05-30 23:02:07.222 14664 TRACE nova.compute.manager [instance: a66809a0-c372-4e52-8ff9-100c7825fb3a]
  2014-05-30 23:03:16.257 | 
  2014-05-30 23:03:16.258 | Log File Has Errors: q-agt
  2014-05-30 23:03:16.259 | *** Not Whitelisted *** 2014-05-30 22:33:13.444 11592 ERROR neutron.agent.linux.ovs_lib [-] Unable to execute ['ovs-vsctl', '--timeout=10', 'set', 'Port', u'qr-8cab2a65-c0', 'tag=4095']. Exception:
  2014-05-30 23:03:16.354 | Logs have errors
  2014-05-30 23:03:16.355 | ok

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1325126/+subscriptions
References

[Bug 1325126] [NEW] Failed to deallocate networks: unable to execute ovs-vsctl
From: Joshua Harlow, 2014-05-30