← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1340473] [NEW] dhcp agent create broken network namespace

 

Public bug reported:

Running dhcp agent, get error as below:

2014-07-10 23:18:41.932 ERROR neutron.agent.dhcp_agent [-] Unable to enable dhcp for 72cad723-3ce1-402b-ac4b-746274cbad9d.
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Traceback (most recent call last):
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/dhcp_agent.py", line 129, in call_driver
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     getattr(driver, action)(**action_kwargs)
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/dhcp.py", line 191, in enable
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     interface_name = self.device_manager.setup(self.network)
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/dhcp.py", line 894, in setup
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace=network.namespace)
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/interface.py", line 368, in plug
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace2=namespace)
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 125, in add_veth
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     self.ensure_namespace(namespace2)
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 137, in ensure_namespace
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     lo.link.set_up()
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 248, in set_up
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     self._as_root('set', self.name, 'up')
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 229, in _as_root
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     kwargs.get('use_root_namespace', False))
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 69, in _as_root
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace)
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 80, in _execute
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     root_helper=root_helper)
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/utils.py", line 76, in execute
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     raise RuntimeError(m)
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent RuntimeError:
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Command: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-72cad723-3ce1-402b-ac4b-746274cbad9d', 'ip', 'link', 'set', 'lo', 'up']
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Exit code: 1
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Stdout: ''
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Stderr: 'seting the network namespace "qdhcp-72cad723-3ce1-402b-ac4b-746274cbad9d" failed: Invalid argument\n'
2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent

** Affects: neutron
     Importance: Undecided
         Status: New

** Description changed:

  Running dhcp agent, get error as below:
  
  2014-07-10 23:18:41.932 ERROR neutron.agent.dhcp_agent [-] Unable to enable dhcp for 72cad723-3ce1-402b-ac4b-746274cbad9d.
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Traceback (most recent call last):
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/dhcp_agent.py", line 129, in call_driver
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     getattr(driver, action)(**action_kwargs)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/dhcp.py", line 191, in enable
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     interface_name = self.device_manager.setup(self.network)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/dhcp.py", line 894, in setup
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace=network.namespace)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/interface.py", line 368, in plug
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace2=namespace)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 125, in add_veth
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     self.ensure_namespace(namespace2)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 137, in ensure_namespace
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     lo.link.set_up()
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 248, in set_up
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     self._as_root('set', self.name, 'up')
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 229, in _as_root
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     kwargs.get('use_root_namespace', False))
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 69, in _as_root
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 80, in _execute
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     root_helper=root_helper)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/utils.py", line 76, in execute
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     raise RuntimeError(m)
- 2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent RuntimeError: 
+ 2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent RuntimeError:
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Command: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-72cad723-3ce1-402b-ac4b-746274cbad9d', 'ip', 'link', 'set', 'lo', 'up']
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Exit code: 1
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Stdout: ''
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Stderr: 'seting the network namespace "qdhcp-72cad723-3ce1-402b-ac4b-746274cbad9d" failed: Invalid argument\n'
- 2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent 
- 
- 
- After I reboot my ubuntu14.04, I execute:
- 'ip netns add testns'
- 'ip netns exec testns ifconfig'
- 
- This is works.
- 
- 
- But If I execute:
- sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ip netns add testns
- sudo ip netns exec testns ifconfig
- 
- Then I got same error as above.
+ 2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1340473

Title:
  dhcp agent create broken network namespace

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  Running dhcp agent, get error as below:

  2014-07-10 23:18:41.932 ERROR neutron.agent.dhcp_agent [-] Unable to enable dhcp for 72cad723-3ce1-402b-ac4b-746274cbad9d.
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Traceback (most recent call last):
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/dhcp_agent.py", line 129, in call_driver
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     getattr(driver, action)(**action_kwargs)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/dhcp.py", line 191, in enable
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     interface_name = self.device_manager.setup(self.network)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/dhcp.py", line 894, in setup
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace=network.namespace)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/interface.py", line 368, in plug
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace2=namespace)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 125, in add_veth
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     self.ensure_namespace(namespace2)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 137, in ensure_namespace
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     lo.link.set_up()
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 248, in set_up
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     self._as_root('set', self.name, 'up')
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 229, in _as_root
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     kwargs.get('use_root_namespace', False))
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 69, in _as_root
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     namespace)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/ip_lib.py", line 80, in _execute
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     root_helper=root_helper)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent   File "/opt/stack/neutron/neutron/agent/linux/utils.py", line 76, in execute
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent     raise RuntimeError(m)
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent RuntimeError:
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Command: ['sudo', '/usr/local/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-72cad723-3ce1-402b-ac4b-746274cbad9d', 'ip', 'link', 'set', 'lo', 'up']
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Exit code: 1
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Stdout: ''
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent Stderr: 'seting the network namespace "qdhcp-72cad723-3ce1-402b-ac4b-746274cbad9d" failed: Invalid argument\n'
  2014-07-10 23:18:41.932 TRACE neutron.agent.dhcp_agent

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1340473/+subscriptions


Follow ups

References