yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1413231] [NEW] Traceback when creating VxLAN network using CSR plugin

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Richard Winters <riwinter@xxxxxxxxx>
Date: Wed, 21 Jan 2015 14:33:20 -0000
Reply-to: Bug 1413231 <1413231@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

OpenStack Version: Kilo

localadmin@qa1:~$ nova-manage version
2015.1
localadmin@qa1:~$ neutron --version
2.3.10

I’m trying to run the vxlan tests on my multi node setup and I’m seeing
the following  error/traceback in the screen-q-ciscocfgagent.log when
creating a network with a vxlan profile.

The error complains that it can’t find the nrouter-56f2cf VRF but it is
present on the CSR.

VRF is configured on the CSR – regular VLAN works fine

csr#show run | inc vrf
vrf definition Mgmt-intf
vrf definition nrouter-56f2cf
 vrf forwarding nrouter-56f2cf
 vrf forwarding nrouter-56f2cf
 vrf forwarding nrouter-56f2cf
ip nat inside source list acl_756 interface GigabitEthernet3.757 vrf nrouter-56f2cf overload
ip nat inside source list acl_758 interface GigabitEthernet3.757 vrf nrouter-56f2cf overload
ip nat inside source static 10.11.12.2 172.29.75.232 vrf nrouter-56f2cf match-in-vrf
ip nat inside source static 10.11.12.4 172.29.75.233 vrf nrouter-56f2cf match-in-vrf
ip nat inside source static 10.11.12.5 172.29.75.234 vrf nrouter-56f2cf match-in-vrf
ip nat inside source static 210.168.1.2 172.29.75.235 vrf nrouter-56f2cf match-in-vrf
ip nat inside source static 210.168.1.4 172.29.75.236 vrf nrouter-56f2cf match-in-vrf
ip nat inside source static 210.168.1.5 172.29.75.237 vrf nrouter-56f2cf match-in-vrf
ip route vrf nrouter-56f2cf 0.0.0.0 0.0.0.0 172.29.75.225
csr#


2015-01-19 12:22:09.896 DEBUG neutron.agent.linux.utils [-] 
Command: ['ping', '-c', '5', '-W', '1', '-i', '0.2', '10.0.100.10']
Exit code: 0
Stdout: 'PING 10.0.100.10 (10.0.100.10) 56(84) bytes of data.\n64 bytes from 10.0.100.10: icmp_seq=1 ttl=255 time=1.74 ms\n64 bytes from 10.0.100.10: icmp_seq=2 ttl=255 time=1.09 ms\n64 bytes from 10.0.100.10: icmp_seq=3 ttl=255 time=0.994 ms\n64 bytes from 10.0.100.10: icmp_seq=4 ttl=255 time=0.852 ms\n64 bytes 
from 10.0.100.10: icmp_seq=5 ttl=255 time=0.892 ms\n\n--- 10.0.100.10 ping statistics ---\n5 packets transmitted, 5 received, 0% packet loss, time 801ms\nrtt min/avg/max/mdev = 0.852/1.116/1.748/0.328 ms\n'
Stderr: '' from (pid=13719) execute /opt/stack/neutron/neutron/agent/linux/utils.py:79
2015-01-19 12:22:09.897 DEBUG neutron.plugins.cisco.cfg_agent.device_status [-] Hosting device: 27b14fc6-b1c9-4deb-8abe-ae3703a4af2d@10.0.100.10 is reachable. from (pid=13719) is_hosting_device_reachable /opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_status.py:115
2015-01-19 12:22:10.121 INFO neutron.plugins.cisco.cfg_agent.device_drivers.csr1kv.csr1kv_routing_driver [-] VRFs:[]
2015-01-19 12:22:10.122 ERROR neutron.plugins.cisco.cfg_agent.device_drivers.csr1kv.csr1kv_routing_driver [-] VRF nrouter-56f2cf not present
2015-01-19 12:22:10.237 DEBUG neutron.plugins.cisco.cfg_agent.device_drivers.csr1kv.csr1kv_routing_driver [-] RPCReply for CREATE_SUBINTERFACE is <?xml version="1.0" encoding="UTF-8"?><rpc-reply message-id="urn:uuid:b3476042-9fff-11e4-b07d-f872eaedf376" xmlns="urn:ietf:params:netconf:base:1.0"><rpc-error><error-type>protocol</error-type><error-tag>operation-failed</error-tag><error-severity>error</error-severity></rpc-error></rpc-reply> from (pid=13719) _check_response /opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py:676
2015-01-19 12:22:10.238 ERROR neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper [-] Error executing snippet:CREATE_SUBINTERFACE. ErrorType:protocol ErrorTag:operation-failed.
2015-01-19 12:22:10.238 ERROR neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper [-] Driver Exception on router:56f2cfbc-61c6-45dc-94d5-0cbb08b05053. Error is Error executing snippet:CREATE_SUBINTERFACE. ErrorType:protocol ErrorTag:operation-failed.


2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper Traceback (most recent call last):
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/service_helpers/routing_svc_helper.py", line 379, in _process_routers
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._process_router(ri)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/service_helpers/routing_svc_helper.py", line 452, in _process_router
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     LOG.error(e)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/usr/local/lib/python2.7/dist-packages/oslo/utils/excutils.py", line 82, in __exit__
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     six.reraise(self.type_, self.value, self.tb)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/service_helpers/routing_svc_helper.py", line 431, in _process_router
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._internal_network_added(ri, p, ex_gw_port)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/service_helpers/routing_svc_helper.py", line 564, in _internal_network_added
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     driver.internal_network_added(ri, port)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 75, in internal_network_added
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._csr_create_subinterface(ri, port)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 125, in _csr_create_subinterface
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     gateway_ip, netmask)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 485, in _create_subinterface
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._edit_running_config(confstr, 'CREATE_SUBINTERFACE')
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 646, in _edit_running_config
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._check_response(rpc_obj, snippet)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 686, in _check_response
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     raise cfg_exc.CSR1kvConfigException(**params)
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper CSR1kvConfigException: Error executing snippet:CREATE_SUBINTERFACE. ErrorType:protocol ErrorTag:operation-failed.
2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper 
localadmin@qa1:/

** Affects: neutron
     Importance: Undecided
         Status: New


** Tags: cisco

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1413231

Title:
  Traceback when creating VxLAN network using CSR plugin

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  OpenStack Version: Kilo

  localadmin@qa1:~$ nova-manage version
  2015.1
  localadmin@qa1:~$ neutron --version
  2.3.10

  I’m trying to run the vxlan tests on my multi node setup and I’m
  seeing the following  error/traceback in the
  screen-q-ciscocfgagent.log when creating a network with a vxlan
  profile.

  The error complains that it can’t find the nrouter-56f2cf VRF but it
  is present on the CSR.

  VRF is configured on the CSR – regular VLAN works fine

  csr#show run | inc vrf
  vrf definition Mgmt-intf
  vrf definition nrouter-56f2cf
   vrf forwarding nrouter-56f2cf
   vrf forwarding nrouter-56f2cf
   vrf forwarding nrouter-56f2cf
  ip nat inside source list acl_756 interface GigabitEthernet3.757 vrf nrouter-56f2cf overload
  ip nat inside source list acl_758 interface GigabitEthernet3.757 vrf nrouter-56f2cf overload
  ip nat inside source static 10.11.12.2 172.29.75.232 vrf nrouter-56f2cf match-in-vrf
  ip nat inside source static 10.11.12.4 172.29.75.233 vrf nrouter-56f2cf match-in-vrf
  ip nat inside source static 10.11.12.5 172.29.75.234 vrf nrouter-56f2cf match-in-vrf
  ip nat inside source static 210.168.1.2 172.29.75.235 vrf nrouter-56f2cf match-in-vrf
  ip nat inside source static 210.168.1.4 172.29.75.236 vrf nrouter-56f2cf match-in-vrf
  ip nat inside source static 210.168.1.5 172.29.75.237 vrf nrouter-56f2cf match-in-vrf
  ip route vrf nrouter-56f2cf 0.0.0.0 0.0.0.0 172.29.75.225
  csr#


  2015-01-19 12:22:09.896 DEBUG neutron.agent.linux.utils [-] 
  Command: ['ping', '-c', '5', '-W', '1', '-i', '0.2', '10.0.100.10']
  Exit code: 0
  Stdout: 'PING 10.0.100.10 (10.0.100.10) 56(84) bytes of data.\n64 bytes from 10.0.100.10: icmp_seq=1 ttl=255 time=1.74 ms\n64 bytes from 10.0.100.10: icmp_seq=2 ttl=255 time=1.09 ms\n64 bytes from 10.0.100.10: icmp_seq=3 ttl=255 time=0.994 ms\n64 bytes from 10.0.100.10: icmp_seq=4 ttl=255 time=0.852 ms\n64 bytes 
  from 10.0.100.10: icmp_seq=5 ttl=255 time=0.892 ms\n\n--- 10.0.100.10 ping statistics ---\n5 packets transmitted, 5 received, 0% packet loss, time 801ms\nrtt min/avg/max/mdev = 0.852/1.116/1.748/0.328 ms\n'
  Stderr: '' from (pid=13719) execute /opt/stack/neutron/neutron/agent/linux/utils.py:79
  2015-01-19 12:22:09.897 DEBUG neutron.plugins.cisco.cfg_agent.device_status [-] Hosting device: 27b14fc6-b1c9-4deb-8abe-ae3703a4af2d@10.0.100.10 is reachable. from (pid=13719) is_hosting_device_reachable /opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_status.py:115
  2015-01-19 12:22:10.121 INFO neutron.plugins.cisco.cfg_agent.device_drivers.csr1kv.csr1kv_routing_driver [-] VRFs:[]
  2015-01-19 12:22:10.122 ERROR neutron.plugins.cisco.cfg_agent.device_drivers.csr1kv.csr1kv_routing_driver [-] VRF nrouter-56f2cf not present
  2015-01-19 12:22:10.237 DEBUG neutron.plugins.cisco.cfg_agent.device_drivers.csr1kv.csr1kv_routing_driver [-] RPCReply for CREATE_SUBINTERFACE is <?xml version="1.0" encoding="UTF-8"?><rpc-reply message-id="urn:uuid:b3476042-9fff-11e4-b07d-f872eaedf376" xmlns="urn:ietf:params:netconf:base:1.0"><rpc-error><error-type>protocol</error-type><error-tag>operation-failed</error-tag><error-severity>error</error-severity></rpc-error></rpc-reply> from (pid=13719) _check_response /opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py:676
  2015-01-19 12:22:10.238 ERROR neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper [-] Error executing snippet:CREATE_SUBINTERFACE. ErrorType:protocol ErrorTag:operation-failed.
  2015-01-19 12:22:10.238 ERROR neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper [-] Driver Exception on router:56f2cfbc-61c6-45dc-94d5-0cbb08b05053. Error is Error executing snippet:CREATE_SUBINTERFACE. ErrorType:protocol ErrorTag:operation-failed.

  
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper Traceback (most recent call last):
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/service_helpers/routing_svc_helper.py", line 379, in _process_routers
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._process_router(ri)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/service_helpers/routing_svc_helper.py", line 452, in _process_router
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     LOG.error(e)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/usr/local/lib/python2.7/dist-packages/oslo/utils/excutils.py", line 82, in __exit__
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     six.reraise(self.type_, self.value, self.tb)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/service_helpers/routing_svc_helper.py", line 431, in _process_router
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._internal_network_added(ri, p, ex_gw_port)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/service_helpers/routing_svc_helper.py", line 564, in _internal_network_added
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     driver.internal_network_added(ri, port)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 75, in internal_network_added
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._csr_create_subinterface(ri, port)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 125, in _csr_create_subinterface
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     gateway_ip, netmask)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 485, in _create_subinterface
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._edit_running_config(confstr, 'CREATE_SUBINTERFACE')
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 646, in _edit_running_config
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     self._check_response(rpc_obj, snippet)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper   File "/opt/stack/neutron/neutron/plugins/cisco/cfg_agent/device_drivers/csr1kv/csr1kv_routing_driver.py", line 686, in _check_response
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper     raise cfg_exc.CSR1kvConfigException(**params)
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper CSR1kvConfigException: Error executing snippet:CREATE_SUBINTERFACE. ErrorType:protocol ErrorTag:operation-failed.
  2015-01-19 12:22:10.238 TRACE neutron.plugins.cisco.cfg_agent.service_helpers.routing_svc_helper 
  localadmin@qa1:/

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1413231/+subscriptions
Follow ups

[Bug 1413231] Re: Traceback when creating VxLAN network using CSR plugin
From: Launchpad Bug Tracker, 2015-12-09
[Bug 1413231] Re: Traceback when creating VxLAN network using CSR plugin
From: Armando Migliaccio, 2015-10-10
[Bug 1413231] Re: Traceback when creating VxLAN network using CSR plugin
From: Eugene Nikanorov, 2015-04-06
[Bug 1413231] [NEW] Traceback when creating VxLAN network using CSR plugin
From: Richard Winters, 2015-01-21
References

[Bug 1413231] [NEW] Traceback when creating VxLAN network using CSR plugin
From: Richard Winters, 2015-01-21