yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1275500] [NEW] Cannot reboot instance: Network filter not found: Could not find filter

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Attila Fazekas <afazekas@xxxxxxxxxx>
Date: Sun, 02 Feb 2014 17:35:49 -0000
Reply-to: Bug 1275500 <1275500@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

The issue seen with nova network.

test_reboot_server_hard tempest test failed.
http://logs.openstack.org/58/68058/3/check/check-tempest-dsvm-full/5b5e95d/console.html
2014-02-02 10:26:05.058 | Traceback (most recent call last):
2014-02-02 10:26:05.058 |   File "tempest/api/compute/servers/test_server_actions.py", line 81, in test_reboot_server_hard
2014-02-02 10:26:05.058 |     self.client.wait_for_server_status(self.server_id, 'ACTIVE')
2014-02-02 10:26:05.058 |   File "tempest/services/compute/json/servers_client.py", line 163, in wait_for_server_status
2014-02-02 10:26:05.058 |     raise_on_error=raise_on_error)
2014-02-02 10:26:05.058 |   File "tempest/common/waiters.py", line 74, in wait_for_server_status
2014-02-02 10:26:05.058 |     raise exceptions.BuildErrorException(server_id=server_id)
2014-02-02 10:26:05.058 | BuildErrorException: Server 31b23b53-34e4-4e77-8492-ef6c301d2477 failed to build and is in ERROR status

http://logs.openstack.org/58/68058/3/check/check-tempest-dsvm-full/5b5e95d/logs/screen-n-cpu.txt.gz#_2014-02-02_09_53_15_466
2014-02-02 09:53:15.837 ERROR nova.openstack.common.rpc.amqp [req-05280e6c-a093-4449-ba63-c4e3a8bf8e4f ServerActionsTestJSON-465780825 ServerActionsTestJSON-704935155] Exception during message handling
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     **args)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/exception.py", line 90, in wrapped
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     payload)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 68, in __exit__
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/exception.py", line 73, in wrapped
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 241, in decorated_function
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     pass
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 68, in __exit__
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 227, in decorated_function
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 292, in decorated_function
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 269, in decorated_function
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 68, in __exit__
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 256, in decorated_function
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 2400, in reboot_instance
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     bad_volumes_callback=bad_volumes_callback)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 1949, in reboot
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     block_device_info)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 2054, in _hard_reboot
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     block_device_info, reboot=True)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 3469, in _create_domain_and_network
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     self.firewall_driver.setup_basic_filtering(instance, network_info)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/firewall.py", line 297, in setup_basic_filtering
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     self.nwfilter.setup_basic_filtering(instance, network_info)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/firewall.py", line 133, in setup_basic_filtering
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     vif))
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/firewall.py", line 241, in _define_filter
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     self._conn.nwfilterDefineXML(xml)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     result = proxy_call(self._autowrap, f, *args, **kwargs)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     rv = execute(f,*args,**kwargs)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     rv = meth(*args,**kwargs)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 2651, in nwfilterDefineXML
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     if ret is None:raise libvirtError('virNWFilterDefineXML() failed', conn=self)
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp libvirtError: Network filter not found: Could not find filter 'nova-instance-instance-0000004b-fa163e53222a'
2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1275500

Title:
  Cannot reboot instance: Network filter not found: Could not find
  filter

Status in OpenStack Compute (Nova):
  New

Bug description:
  The issue seen with nova network.

  test_reboot_server_hard tempest test failed.
  http://logs.openstack.org/58/68058/3/check/check-tempest-dsvm-full/5b5e95d/console.html
  2014-02-02 10:26:05.058 | Traceback (most recent call last):
  2014-02-02 10:26:05.058 |   File "tempest/api/compute/servers/test_server_actions.py", line 81, in test_reboot_server_hard
  2014-02-02 10:26:05.058 |     self.client.wait_for_server_status(self.server_id, 'ACTIVE')
  2014-02-02 10:26:05.058 |   File "tempest/services/compute/json/servers_client.py", line 163, in wait_for_server_status
  2014-02-02 10:26:05.058 |     raise_on_error=raise_on_error)
  2014-02-02 10:26:05.058 |   File "tempest/common/waiters.py", line 74, in wait_for_server_status
  2014-02-02 10:26:05.058 |     raise exceptions.BuildErrorException(server_id=server_id)
  2014-02-02 10:26:05.058 | BuildErrorException: Server 31b23b53-34e4-4e77-8492-ef6c301d2477 failed to build and is in ERROR status

  http://logs.openstack.org/58/68058/3/check/check-tempest-dsvm-full/5b5e95d/logs/screen-n-cpu.txt.gz#_2014-02-02_09_53_15_466
  2014-02-02 09:53:15.837 ERROR nova.openstack.common.rpc.amqp [req-05280e6c-a093-4449-ba63-c4e3a8bf8e4f ServerActionsTestJSON-465780825 ServerActionsTestJSON-704935155] Exception during message handling
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/rpc/amqp.py", line 461, in _process_data
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     **args)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/rpc/dispatcher.py", line 172, in dispatch
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     result = getattr(proxyobj, method)(ctxt, **kwargs)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/exception.py", line 90, in wrapped
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     payload)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/exception.py", line 73, in wrapped
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 241, in decorated_function
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     pass
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 227, in decorated_function
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 292, in decorated_function
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 269, in decorated_function
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/openstack/common/excutils.py", line 68, in __exit__
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     six.reraise(self.type_, self.value, self.tb)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 256, in decorated_function
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/compute/manager.py", line 2400, in reboot_instance
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     bad_volumes_callback=bad_volumes_callback)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 1949, in reboot
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     block_device_info)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 2054, in _hard_reboot
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     block_device_info, reboot=True)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/driver.py", line 3469, in _create_domain_and_network
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     self.firewall_driver.setup_basic_filtering(instance, network_info)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/firewall.py", line 297, in setup_basic_filtering
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     self.nwfilter.setup_basic_filtering(instance, network_info)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/firewall.py", line 133, in setup_basic_filtering
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     vif))
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/opt/stack/new/nova/nova/virt/libvirt/firewall.py", line 241, in _define_filter
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     self._conn.nwfilterDefineXML(xml)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 179, in doit
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     result = proxy_call(self._autowrap, f, *args, **kwargs)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 139, in proxy_call
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     rv = execute(f,*args,**kwargs)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/usr/local/lib/python2.7/dist-packages/eventlet/tpool.py", line 77, in tworker
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     rv = meth(*args,**kwargs)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/libvirt.py", line 2651, in nwfilterDefineXML
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp     if ret is None:raise libvirtError('virNWFilterDefineXML() failed', conn=self)
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp libvirtError: Network filter not found: Could not find filter 'nova-instance-instance-0000004b-fa163e53222a'
  2014-02-02 09:53:15.837 28606 TRACE nova.openstack.common.rpc.amqp

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1275500/+subscriptions
Follow ups

[Bug 1275500] Re: Cannot reboot instance: Network filter not found: Could not find filter
From: Davanum Srinivas (DIMS), 2014-07-01
[Bug 1275500] [NEW] Cannot reboot instance: Network filter not found: Could not find filter
From: Attila Fazekas, 2014-02-02
References

[Bug 1275500] [NEW] Cannot reboot instance: Network filter not found: Could not find filter
From: Attila Fazekas, 2014-02-02