yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1820865] [NEW] Fullstack tests are failing because of "OSError: [Errno 22] failed to open netns"

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Slawek Kaplonski <1820865@xxxxxxxxxxxxxxxxxx>
Date: Tue, 19 Mar 2019 14:33:54 -0000
Reply-to: Bug 1820865 <1820865@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Example of failure: http://logs.openstack.org/52/586252/36/check
/neutron-fullstack/daab6f7/job-output.txt.gz

Test traceback:
 Captured traceback:
2019-03-17 15:28:33.814167 | primary | 2019-03-17 15:28:33.813 | ~~~~~~~~~~~~~~~~~~~
2019-03-17 15:28:33.816364 | primary | 2019-03-17 15:28:33.815 |     b'Traceback (most recent call last):'
2019-03-17 15:28:33.818734 | primary | 2019-03-17 15:28:33.818 |     b'  File "/opt/stack/new/neutron/neutron/tests/base.py", line 174, in func'
2019-03-17 15:28:33.820703 | primary | 2019-03-17 15:28:33.820 |     b'    return f(self, *args, **kwargs)'
2019-03-17 15:28:33.823297 | primary | 2019-03-17 15:28:33.822 |     b'  File "/opt/stack/new/neutron/neutron/tests/fullstack/test_l3_agent.py", line 166, in test_mtu_update'
2019-03-17 15:28:33.825622 | primary | 2019-03-17 15:28:33.825 |     b'    common_utils.wait_until_true(lambda: ip.get_devices())'
2019-03-17 15:28:33.827812 | primary | 2019-03-17 15:28:33.827 |     b'  File "/opt/stack/new/neutron/neutron/common/utils.py", line 684, in wait_until_true'
2019-03-17 15:28:33.829764 | primary | 2019-03-17 15:28:33.829 |     b'    while not predicate():'
2019-03-17 15:28:33.831982 | primary | 2019-03-17 15:28:33.831 |     b'  File "/opt/stack/new/neutron/neutron/tests/fullstack/test_l3_agent.py", line 166, in <lambda>'
2019-03-17 15:28:33.834421 | primary | 2019-03-17 15:28:33.833 |     b'    common_utils.wait_until_true(lambda: ip.get_devices())'
2019-03-17 15:28:40.262004 | primary | 2019-03-17 15:28:40.261 |     b'  File "/opt/stack/new/neutron/neutron/agent/linux/ip_lib.py", line 162, in get_devices'
2019-03-17 15:28:40.263952 | primary | 2019-03-17 15:28:40.263 |     b'    devices = privileged.get_device_names(self.namespace)'
2019-03-17 15:28:40.266330 | primary | 2019-03-17 15:28:40.265 |     b'  File "/opt/stack/new/neutron/neutron/privileged/agent/linux/ip_lib.py", line 567, in get_device_names'
2019-03-17 15:28:40.268162 | primary | 2019-03-17 15:28:40.267 |     b'    in get_link_devices(namespace, **kwargs)]'
2019-03-17 15:28:40.270638 | primary | 2019-03-17 15:28:40.269 |     b'  File "/opt/stack/new/neutron/.tox/dsvm-fullstack/lib/python3.6/site-packages/oslo_privsep/priv_context.py", line 241, in _wrap'
2019-03-17 15:28:40.272582 | primary | 2019-03-17 15:28:40.272 |     b'    return self.channel.remote_call(name, args, kwargs)'
2019-03-17 15:28:40.274822 | primary | 2019-03-17 15:28:40.274 |     b'  File "/opt/stack/new/neutron/.tox/dsvm-fullstack/lib/python3.6/site-packages/oslo_privsep/daemon.py", line 203, in remote_call'
2019-03-17 15:28:40.276631 | primary | 2019-03-17 15:28:40.276 |     b'    raise exc_type(*result[2])'
2019-03-17 15:28:40.278636 | primary | 2019-03-17 15:28:40.278 |     b'OSError: [Errno 22] failed to open netns'


Logstash query: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22failed%20to%20open%20netns%5C%22%20AND%20build_name%3A%5C%22neutron-fullstack%5C%22

** Affects: neutron
     Importance: Critical
         Status: Confirmed


** Tags: fullstack

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1820865

Title:
  Fullstack tests are failing because of "OSError: [Errno 22] failed to
  open netns"

Status in neutron:
  Confirmed

Bug description:
  Example of failure: http://logs.openstack.org/52/586252/36/check
  /neutron-fullstack/daab6f7/job-output.txt.gz

  Test traceback:
   Captured traceback:
  2019-03-17 15:28:33.814167 | primary | 2019-03-17 15:28:33.813 | ~~~~~~~~~~~~~~~~~~~
  2019-03-17 15:28:33.816364 | primary | 2019-03-17 15:28:33.815 |     b'Traceback (most recent call last):'
  2019-03-17 15:28:33.818734 | primary | 2019-03-17 15:28:33.818 |     b'  File "/opt/stack/new/neutron/neutron/tests/base.py", line 174, in func'
  2019-03-17 15:28:33.820703 | primary | 2019-03-17 15:28:33.820 |     b'    return f(self, *args, **kwargs)'
  2019-03-17 15:28:33.823297 | primary | 2019-03-17 15:28:33.822 |     b'  File "/opt/stack/new/neutron/neutron/tests/fullstack/test_l3_agent.py", line 166, in test_mtu_update'
  2019-03-17 15:28:33.825622 | primary | 2019-03-17 15:28:33.825 |     b'    common_utils.wait_until_true(lambda: ip.get_devices())'
  2019-03-17 15:28:33.827812 | primary | 2019-03-17 15:28:33.827 |     b'  File "/opt/stack/new/neutron/neutron/common/utils.py", line 684, in wait_until_true'
  2019-03-17 15:28:33.829764 | primary | 2019-03-17 15:28:33.829 |     b'    while not predicate():'
  2019-03-17 15:28:33.831982 | primary | 2019-03-17 15:28:33.831 |     b'  File "/opt/stack/new/neutron/neutron/tests/fullstack/test_l3_agent.py", line 166, in <lambda>'
  2019-03-17 15:28:33.834421 | primary | 2019-03-17 15:28:33.833 |     b'    common_utils.wait_until_true(lambda: ip.get_devices())'
  2019-03-17 15:28:40.262004 | primary | 2019-03-17 15:28:40.261 |     b'  File "/opt/stack/new/neutron/neutron/agent/linux/ip_lib.py", line 162, in get_devices'
  2019-03-17 15:28:40.263952 | primary | 2019-03-17 15:28:40.263 |     b'    devices = privileged.get_device_names(self.namespace)'
  2019-03-17 15:28:40.266330 | primary | 2019-03-17 15:28:40.265 |     b'  File "/opt/stack/new/neutron/neutron/privileged/agent/linux/ip_lib.py", line 567, in get_device_names'
  2019-03-17 15:28:40.268162 | primary | 2019-03-17 15:28:40.267 |     b'    in get_link_devices(namespace, **kwargs)]'
  2019-03-17 15:28:40.270638 | primary | 2019-03-17 15:28:40.269 |     b'  File "/opt/stack/new/neutron/.tox/dsvm-fullstack/lib/python3.6/site-packages/oslo_privsep/priv_context.py", line 241, in _wrap'
  2019-03-17 15:28:40.272582 | primary | 2019-03-17 15:28:40.272 |     b'    return self.channel.remote_call(name, args, kwargs)'
  2019-03-17 15:28:40.274822 | primary | 2019-03-17 15:28:40.274 |     b'  File "/opt/stack/new/neutron/.tox/dsvm-fullstack/lib/python3.6/site-packages/oslo_privsep/daemon.py", line 203, in remote_call'
  2019-03-17 15:28:40.276631 | primary | 2019-03-17 15:28:40.276 |     b'    raise exc_type(*result[2])'
  2019-03-17 15:28:40.278636 | primary | 2019-03-17 15:28:40.278 |     b'OSError: [Errno 22] failed to open netns'

  
  Logstash query: http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22failed%20to%20open%20netns%5C%22%20AND%20build_name%3A%5C%22neutron-fullstack%5C%22

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1820865/+subscriptions
Follow ups

[Bug 1820865] Re: Fullstack tests are failing because of "OSError: [Errno 22] failed to open netns"
From: OpenStack Infra, 2019-03-28