openstack team mailing list archive
-
openstack team
-
Mailing list archive
-
Message #25014
Re: Grizzly GRE tunneling network set up problems
Aaron
I followed instructions in
http://n40lab.wordpress.com/2013/06/03/centos-6-4-openvswitch-installation/
on my compute node as a test. Restarted OVS, but still see the same
error in the ovs-vswitchd.log. This is what I have
kmod-openvswitch.x86_64 1.10.0-1.el6
@/kmod-openvswitch-1.10.0-1.el6.x86_64
openstack-quantum-openvswitch.noarch 2013.1.2-1.el6
@openstack-grizzly
openvswitch.x86_64 1.10.0-1.el6
@openstack-grizzly
filename:
/lib/modules/2.6.32-358.111.1.openstack.el6.x86_64/extra/openvswitch/openvswitch.ko
version: 1.10.0
license: GPL
description: Open vSwitch switching datapath
srcversion: 480D55A9BB0E8B000E32010
depends:
vermagic: 2.6.32-358.111.1.openstack.el6.x86_64 SMP mod_unload
modversions
parm: vlan_tso:Enable TSO for VLAN packets (int)
# find / -name openvswitch.ko | xargs ls -l
-rw-r--r-- 1 ovswitch ovswitch 4948350 Jul 9 21:41
/home/ovswitch/rpmbuild/BUILD/openvswitch-1.10.0/_default/datapath/linux/openvswitch.ko
-rw-r--r-- 1 root root 4948350 Jul 9 21:41
/lib/modules/2.6.32-358.111.1.openstack.el6.x86_64/extra/openvswitch/openvswitch.ko
-rwxr--r-- 1 root root 77936 Jun 12 20:19
/lib/modules/2.6.32-358.111.1.openstack.el6.x86_64/kernel/net/openvswitch/openvswitch.ko
-rwxr--r-- 1 root root 72912 Jun 12 04:36
/lib/modules/2.6.32-358.11.1.el6.x86_64/kernel/net/openvswitch/openvswitch.ko
lrwxrwxrwx 1 root root 83 Jul 9 21:42
/lib/modules/2.6.32-358.11.1.el6.x86_64/weak-updates/openvswitch/openvswitch.ko
-> /lib/modules/2.6.32-358.111.1.openstack.el6.x86_64/extra/openvswitch/openvswitch.ko
anything else I need to check? Does above looks right to you?
Thanks
Haitao
On Tue, Jul 9, 2013 at 10:29 PM, Aaron Rosen <arosen@xxxxxxxxxx> wrote:
> You should be able to compile openvswitch from source here :
> http://openvswitch.org/download/ and then you'll get tunnel support.
>
> Aaron
>
>
> On Tue, Jul 9, 2013 at 10:21 PM, Haitao Jiang <jianghaitao@xxxxxxxxx> wrote:
>>
>> Aaron & Chandler
>>
>> Thanks a lot for the help. I should have mentioned that the host OS is
>> CentOS 6.4 (specifically the kernel from RedHat RDO). I googled and
>> found that it may not have gre tunneling support. Is there anyone who
>> has successfully set up gre with RDO's kernel or it is just can not be
>> done and I should use the VLAN.
>>
>> As Aaron suspected, there are errprs in the OVS agent log:
>>
>> system@ovs-system: failed to add gre-3 as port: Address family not
>> supported by protocol
>>
>> More details below
>>
>> Any pointer will be highly appreciated!
>>
>> Haitao
>> ======================================
>> Here are some outputs on my compute node (.46, .42 is the control node
>> and .44 is the network node):
>>
>>
>> # ovs-vsctl show
>> 1d554b19-2a2b-493d-a123-0efb0aabc7d1
>> Bridge br-int
>> Port br-int
>> Interface br-int
>> type: internal
>> Port "qvo8108425f-ef"
>> tag: 1
>> Interface "qvo8108425f-ef"
>> Port patch-tun
>> Interface patch-tun
>> type: patch
>> options: {peer=patch-int}
>> Bridge br-tun
>> Port br-tun
>> Interface br-tun
>> type: internal
>> Port "gre-3"
>> Interface "gre-3"
>> type: gre
>> options: {in_key=flow, out_key=flow,
>> remote_ip="10.18.250.44"}
>> Port "gre-4"
>> Interface "gre-4"
>> type: gre
>> options: {in_key=flow, out_key=flow,
>> remote_ip="10.18.250.42"}
>> Port patch-int
>> Interface patch-int
>> type: patch
>> options: {peer=patch-tun}
>> ovs_version: "1.10.0"
>>
>> # ovs-ofctl dump-ports br-tun
>> OFPST_PORT reply (xid=0x2): 2 ports
>> port 1: rx pkts=50, bytes=3300, drop=0, errs=0, frame=0, over=0, crc=0
>> tx pkts=0, bytes=0, drop=0, errs=0, coll=0
>> port LOCAL: rx pkts=0, bytes=0, drop=0, errs=0, frame=0, over=0, crc=0
>> tx pkts=140, bytes=9800, drop=0, errs=0, coll=0
>>
>> # uname -r
>> 2.6.32-358.111.1.openstack.el6.x86_64
>>
>> # modinfo openvswitch
>> filename:
>>
>> /lib/modules/2.6.32-358.111.1.openstack.el6.x86_64/extra/openvswitch/openvswitch.ko
>> version: 1.10.0
>> license: GPL
>> description: Open vSwitch switching datapath
>> srcversion: 480D55A9BB0E8B000E32010
>> depends:
>> vermagic: 2.6.32-358.111.1.openstack.el6.x86_64 SMP mod_unload
>> modversions
>> parm: vlan_tso:Enable TSO for VLAN packets (int)
>>
>> # tail ovs-vswitchd.log
>>
>> 2013-07-09T23:28:18Z|00002|reconnect|INFO|unix:/var/run/openvswitch/db.sock:
>> connecting...
>>
>> 2013-07-09T23:28:18Z|00003|reconnect|INFO|unix:/var/run/openvswitch/db.sock:
>> connected
>> 2013-07-09T23:28:18Z|00004|bridge|INFO|bridge br-int: added interface
>> patch-tun on port 1
>> 2013-07-09T23:28:18Z|00005|bridge|INFO|bridge br-tun: added interface
>> patch-int on port 1
>> 2013-07-09T23:28:18Z|00006|dpif|WARN|system@ovs-system: failed to add
>> gre-3 as port: Address family not supported by protocol
>> 2013-07-09T23:28:18Z|00007|dpif|WARN|system@ovs-system: failed to add
>> gre-4 as port: Address family not supported by protocol
>> 2013-07-09T23:28:18Z|00008|bridge|INFO|bridge br-int: using datapath
>> ID 0000dacb49a63448
>> 2013-07-09T23:28:18Z|00009|connmgr|INFO|br-int: added service
>> controller "punix:/var/run/openvswitch/br-int.mgmt"
>> 2013-07-09T23:28:18Z|00010|bridge|INFO|bridge br-tun: using datapath
>> ID 00009a14eee01941
>> 2013-07-09T23:28:18Z|00011|connmgr|INFO|br-tun: added service
>> controller "punix:/var/run/openvswitch/br-tun.mgmt"
>> 2013-07-09T23:28:18Z|00012|bridge|INFO|ovs-vswitchd (Open vSwitch) 1.10.0
>> 2013-07-09T23:28:28Z|00013|memory|INFO|7848 kB peak resident set size
>> after 10.0 seconds
>> 2013-07-09T23:28:28Z|00014|memory|INFO|ports:5 rules:11
>> 2013-07-09T23:28:28Z|00015|ofproto|INFO|br-int: 2 flow_mods in the 4 s
>> starting 10 s ago (1 adds, 1 deletes)
>> 2013-07-09T23:28:28Z|00016|ofproto|INFO|br-tun: 5 flow_mods in the 3 s
>> starting 10 s ago (5 adds)
>> 2013-07-09T23:53:25Z|00017|netdev|WARN|failed to set flags for network
>> device patch-int: Operation not supported
>>
>> On Tue, Jul 9, 2013 at 8:59 PM, Aaron Rosen <arosen@xxxxxxxxxx> wrote:
>> > I'd check the quantum openvswitch agent log files. I'd guess the reason
>> > this
>> > isn't working is because your kernel isn't using the openvswitch kernel
>> > module that has tunnel support.
>> >
>> > Aaron
>> >
>> >
>> > On Tue, Jul 9, 2013 at 9:19 AM, Haitao Jiang <jianghaitao@xxxxxxxxx>
>> > wrote:
>> >>
>> >> I just set up a multi-node Grizzly release 2013.2 with 1 controller
>> >> node, 1 network node and 1 compute node. I use GRE tunneling.
>> >>
>> >> I create one VM on the compute node and was not able to ssh to it using
>> >> netns.
>> >>
>> >> One thing I noticed is that on my compute node, I do not have br-int
>> >> and br-tun in the list, nor do I find any GRE tunnels. Am I supposed
>> >> to create the GRE tunnels manually or they should be set up
>> >> automatically by Quantum? Any idea or suggestion to make it work?
>> >>
>> >> Thanks in advance!
>> >>
>> >> ------ Compute node --------
>> >> -- /etc/quantum/plugins/openvswitch/ovs_quantum_plugin.ini --
>> >> tunnel_id_ranges=1:1000
>> >> integration_bridge=br-int
>> >> tunneling_bridge=br-tun
>> >> tenant_network_type=gre
>> >> enable_tunneling=True
>> >> local_ip = <host IP>
>> >>
>> >> # brctl show
>> >> bridge name bridge id STP enabled interfaces
>> >> qbr5a9800b9-26 8000.5242b197c3d3 no
>> >> qvb5a9800b9-26
>> >> tap5a9800b9-26
>> >> virbr0 8000.525400198a10 yes virbr0-nic
>> >>
>> >> # ovs-vsctl show
>> >> 1d554b19-2a2b-493d-a123-0efb0aabc7d1
>> >> Bridge br-tun
>> >> Port patch-int
>> >> Interface patch-int
>> >> type: patch
>> >> options: {peer=patch-tun}
>> >> Port br-tun
>> >> Interface br-tun
>> >> type: internal
>> >> Bridge br-int
>> >> Port br-int
>> >> Interface br-int
>> >> type: internal
>> >> Port patch-tun
>> >> Interface patch-tun
>> >> type: patch
>> >> options: {peer=patch-int}
>> >> Port "qvo5a9800b9-26"
>> >> tag: 1
>> >> Interface "qvo5a9800b9-26"
>> >> ovs_version: "1.10.0"
>> >>
>> >> ------------ network node ---------------
>> >> # brctl show
>> >> bridge name bridge id STP enabled interfaces
>> >>
>> >> # ovs-vsctl show
>> >> b9f0e822-cfc1-4b70-ac5b-abc4e5c258a4
>> >> Bridge br-int
>> >> Port br-int
>> >> Interface br-int
>> >> type: internal
>> >> Port "tap9536e146-c2"
>> >> Interface "tap9536e146-c2"
>> >> Bridge br-ex
>> >> Port br-ex
>> >> Interface br-ex
>> >> type: internal
>> >> ovs_version: "1.10.0"
>> >>
>> >> _______________________________________________
>> >> Mailing list: https://launchpad.net/~openstack
>> >> Post to : openstack@xxxxxxxxxxxxxxxxxxx
>> >> Unsubscribe : https://launchpad.net/~openstack
>> >> More help : https://help.launchpad.net/ListHelp
>> >
>> >
>
>
Follow ups
References
