← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1265441] [NEW] dhcp agent issue when working with ovs vxlan

 

Public bug reported:

Hi list,

I'm working under CentOS 6.4 + Havana.

I'm trying to enable vxlan.

I successfully started an instance, but the instance cant' get IP
address from DHCP agent.

I get an error message in dhcp.log:
2014-01-02 14:38:33.150 17728 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-1314f7bb-9b52-4db8-a677-a751e52aad0e', 'ip', '-o', 'link', 'show', 'ns-45bfc42b-93'] execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:43
2014-01-02 14:38:33.161 17728 DEBUG neutron.agent.linux.utils [-]
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-d250b6d9-0077-41ae-88e1-8736dfd0e165', 'ip', 'route', 'replace', 'default', 'via', '30.1.100.1', 'dev', 'ns-8d8fdae7-1f']
Exit code: 2
Stdout: ''
Stderr: 'RTNETLINK answers: No such process\n' execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:60
2014-01-02 14:38:33.161 17728 ERROR neutron.agent.dhcp_agent [-] Unable to enable dhcp.
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Traceback (most recent call last):
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/dhcp_agent.py", line 126, in call_driver
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     getattr(driver, action)(**action_kwargs)
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/dhcp.py", line 167, in enable
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     reuse_existing=True)
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/dhcp.py", line 724, in setup
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     self._set_default_route(network)
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/dhcp.py", line 612, in _set_default_route
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     device.route.add_gateway(subnet.gateway_ip)
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 359, in add_gateway
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     self._as_root(*args)
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 208, in _as_root
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     kwargs.get('use_root_namespace', False))
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 65, in _as_root
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     namespace)
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 76, in _execute
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     root_helper=root_helper)
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 62, in execute
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     raise RuntimeError(m)
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent RuntimeError:
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-d250b6d9-0077-41ae-88e1-8736dfd0e165', 'ip', 'route', 'replace', 'default', 'via', '30.1.100.1', 'dev', 'ns-8d8fdae7-1f']
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Exit code: 2
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Stdout: ''
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Stderr: 'RTNETLINK answers: No such process\n'
2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent
2014-01-02 14:38:33.267 17728 DEBUG neutron.agent.linux.utils [-]
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-1314f7bb-9b52-4db8-a677-a751e52aad0e', 'ip', '-o', 'link', 'show', 'ns-45bfc42b-93']
Exit code: 0
Stdout: '22: ns-45bfc42b-93: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000\\    link/ether fa:16:3e:b0:33:b6 brd ff:ff:ff:ff:ff:ff\n'
Stderr: '' execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:60
2014-01-02 14:38:33.268 17728 DEBUG neutron.agent.linux.dhcp [-] Reusing existing device: ns-45bfc42b-93. setup /usr/lib/python2.6/site-packages/neutron/agent/linux/dhcp.py:696
2014-01-02 14:38:33.269 17728 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-1314f7bb-9b52-4db8-a677-a751e52aad0e', 'ip', 'addr', 'show', 'ns-45bfc42b-93', 'permanent', 'scope', 'global'] execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:43
2014-01-02 14:38:33.376 17728 DEBUG neutron.agent.linux.utils [-]
Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-1314f7bb-9b52-4db8-a677-a751e52aad0e', 'ip', 'addr', 'show', 'ns-45bfc42b-93', 'permanent', 'scope', 'global']
Exit code: 0
Stdout: '22: ns-45bfc42b-93: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000\n    link/ether fa:16:3e:b0:33:b6 brd ff:ff:ff:ff:ff:ff\n    inet 20.1.100.3/24 brd 20.1.100.255 scope global ns-45bfc42b-93\n'
Stderr: '' execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:60


Anyone know why this happen ???

Thanks.

-chen

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1265441

Title:
  dhcp agent issue when working with ovs vxlan

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  Hi list,

  I'm working under CentOS 6.4 + Havana.

  I'm trying to enable vxlan.

  I successfully started an instance, but the instance cant' get IP
  address from DHCP agent.

  I get an error message in dhcp.log:
  2014-01-02 14:38:33.150 17728 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-1314f7bb-9b52-4db8-a677-a751e52aad0e', 'ip', '-o', 'link', 'show', 'ns-45bfc42b-93'] execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:43
  2014-01-02 14:38:33.161 17728 DEBUG neutron.agent.linux.utils [-]
  Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-d250b6d9-0077-41ae-88e1-8736dfd0e165', 'ip', 'route', 'replace', 'default', 'via', '30.1.100.1', 'dev', 'ns-8d8fdae7-1f']
  Exit code: 2
  Stdout: ''
  Stderr: 'RTNETLINK answers: No such process\n' execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:60
  2014-01-02 14:38:33.161 17728 ERROR neutron.agent.dhcp_agent [-] Unable to enable dhcp.
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Traceback (most recent call last):
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/dhcp_agent.py", line 126, in call_driver
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     getattr(driver, action)(**action_kwargs)
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/dhcp.py", line 167, in enable
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     reuse_existing=True)
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/dhcp.py", line 724, in setup
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     self._set_default_route(network)
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/dhcp.py", line 612, in _set_default_route
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     device.route.add_gateway(subnet.gateway_ip)
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 359, in add_gateway
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     self._as_root(*args)
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 208, in _as_root
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     kwargs.get('use_root_namespace', False))
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 65, in _as_root
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     namespace)
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/ip_lib.py", line 76, in _execute
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     root_helper=root_helper)
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent   File "/usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py", line 62, in execute
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent     raise RuntimeError(m)
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent RuntimeError:
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-d250b6d9-0077-41ae-88e1-8736dfd0e165', 'ip', 'route', 'replace', 'default', 'via', '30.1.100.1', 'dev', 'ns-8d8fdae7-1f']
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Exit code: 2
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Stdout: ''
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent Stderr: 'RTNETLINK answers: No such process\n'
  2014-01-02 14:38:33.161 17728 TRACE neutron.agent.dhcp_agent
  2014-01-02 14:38:33.267 17728 DEBUG neutron.agent.linux.utils [-]
  Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-1314f7bb-9b52-4db8-a677-a751e52aad0e', 'ip', '-o', 'link', 'show', 'ns-45bfc42b-93']
  Exit code: 0
  Stdout: '22: ns-45bfc42b-93: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000\\    link/ether fa:16:3e:b0:33:b6 brd ff:ff:ff:ff:ff:ff\n'
  Stderr: '' execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:60
  2014-01-02 14:38:33.268 17728 DEBUG neutron.agent.linux.dhcp [-] Reusing existing device: ns-45bfc42b-93. setup /usr/lib/python2.6/site-packages/neutron/agent/linux/dhcp.py:696
  2014-01-02 14:38:33.269 17728 DEBUG neutron.agent.linux.utils [-] Running command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-1314f7bb-9b52-4db8-a677-a751e52aad0e', 'ip', 'addr', 'show', 'ns-45bfc42b-93', 'permanent', 'scope', 'global'] execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:43
  2014-01-02 14:38:33.376 17728 DEBUG neutron.agent.linux.utils [-]
  Command: ['sudo', 'neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-1314f7bb-9b52-4db8-a677-a751e52aad0e', 'ip', 'addr', 'show', 'ns-45bfc42b-93', 'permanent', 'scope', 'global']
  Exit code: 0
  Stdout: '22: ns-45bfc42b-93: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000\n    link/ether fa:16:3e:b0:33:b6 brd ff:ff:ff:ff:ff:ff\n    inet 20.1.100.3/24 brd 20.1.100.255 scope global ns-45bfc42b-93\n'
  Stderr: '' execute /usr/lib/python2.6/site-packages/neutron/agent/linux/utils.py:60


  Anyone know why this happen ???

  Thanks.

  -chen

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1265441/+subscriptions


Follow ups

References