openstack team mailing list archive

[Kurt Scholtens <burnbrighter@xxxxxxxxxxx>]

I am looking for guidance on my current deployment.   Let me start by
saying, it works.  That being said, I want to ensure what I am doing makes
sense because I'm slightly confused by the networking.  Specifically, the
bridging doesn't make sense at all.  If you look at my bridging below, it
appears both my public network (192.168.12.x) and my host to host management
network (10.0.5.x) are getting bridged on br100.  More precisely it appears
my FIXED_NETWORK (11.0.4.x) as well as my public network aka FLOATING_RANGE
are getting bridged to  br100.  I do access my openstack hosts on
192.168.12.x as well as my openstack instances on this network.  I just am
not understanding the networking for this set up, even though it works.

What would be considered best practices for this case?  Any help is
appreciated.

A few more details:
I am running a two-node installation under devstack on the essex branch.  I
don't want to overtly complicate things by saying its a virtual
installation, but I feel it's worth mentioning.  I've had to do some crafty
things to get KVM to play nicely with networking.  The eth0 interface is
pretty much unused below.

My cluster configuration node is configured as follows:

convirt@convirt-r01:~/devstack$ cat /etc/network/interfaces
auto lo
iface lo inet loopback

auto eth0
iface eth0 inet dhcp

auto eth1
iface eth1 inet static
address 10.0.5.2
netmask 255.255.255.0

auto eth2
iface eth2 inet static
address 192.168.12.104
netmask 255.255.255.0
gateway 192.168.12.1

convirt@convirt-r01:~/devstack$ netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt
Iface
0.0.0.0         192.168.12.1    0.0.0.0         UG        0 0          0
br100
10.0.4.0        0.0.0.0         255.255.255.0   U         0 0          0
eth0
10.0.5.0        0.0.0.0         255.255.255.0   U         0 0          0
eth1
11.0.4.0        0.0.0.0         255.255.255.0   U         0 0          0
br100
192.168.12.0    0.0.0.0         255.255.255.0   U         0 0          0
br100
192.168.122.0   0.0.0.0         255.255.255.0   U         0 0          0
virbr0

convirt@convirt-r01:~/devstack$ brctl show
bridge name bridge id STP enabled interfaces
br100 8000.00163e098238 no eth2
vnet0
virbr0 8000.000000000000 yes

convirt@convirt-r01:~/devstack$ cat localrc
HOST_IP=192.168.12.104
SWIFT_REPLICAS=1
SWIFT_DATA_DIR=$DEST/data
# FORCE QEMU
CONNECTION_TYPE=libvirt
LIBVIRT_TYPE=qemu
FLOATING_RANGE=192.168.12.64/27
FIXED_RANGE=11.0.4.0/24
FIXED_NETWORK_SIZE=256
FLAT_INTERFACE=eth2
MULTI_HOST=1

My comp node is configured as follows:
HOST_IP=192.168.12.105
FLAT_INTERFACE=eth2
FIXED_RANGE=11.0.4.0/24
FIXED_NETWORK_SIZE=256
FLOATING_RANGE=192.168.12.64/27

# FORCE QEMU
CONNECTION_TYPE=libvirt
LIBVIRT_TYPE=qemu

MULTI_HOST=1
SERVICE_TOKEN=c0nv1rt
MYSQL_HOST=10.0.5.2
RABBIT_HOST=10.0.5.2
GLANCE_HOSTPORT=10.0.5.2:9292
ENABLED_SERVICES=n-cpu,n-net,n-api,n-vol

convirt@convirt-r02:~/devstack$ brctl show
bridge name bridge id STP enabled interfaces
br100 8000.00163e04fdd9 no eth2
vnet0
virbr0 8000.000000000000 yes

convirt@convirt-r02:~/devstack$ cat /etc/network/interfaces
iface lo inet loopback

auto eth0
iface eth0 inet dhcp

auto eth1
iface eth1 inet static
address 10.0.5.3
netmask 255.255.255.0

auto eth2
iface eth2 inet static
address 192.168.12.105
netmask 255.255.255.0
gateway 192.168.12.1

convirt@convirt-r02:~/devstack$ netstat -rn
Kernel IP routing table
Destination     Gateway         Genmask         Flags   MSS Window  irtt
Iface
0.0.0.0         192.168.12.1    0.0.0.0         UG        0 0          0
br100
10.0.4.0        0.0.0.0         255.255.255.0   U         0 0          0
eth0
10.0.5.0        0.0.0.0         255.255.255.0   U         0 0          0
eth1
11.0.4.0        0.0.0.0         255.255.255.0   U         0 0          0
br100
192.168.12.0    0.0.0.0         255.255.255.0   U         0 0          0
br100
192.168.122.0   0.0.0.0         255.255.255.0   U         0 0          0
virbr0