← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #26953

[Bug 1411807] [NEW] linuxbridge using mulicast vxlan w/o l2pop fails

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

I am running Ubuntu 14.04 with a source Juno install updated as of
yesterday. I have two network nodes and two compute nodes. When a VM is
booted the broadcast DHCP request goes out and is received by the
network node dnsmasq process. The unicast DHCP response is sent and is
received by the compute node. It can be captured on the vxlan and Linux
bridge interfaces but is never forwarded to the VM's tap interface which
is on the bridge..


tcpdump on VM's tap interface. DHCP requests go out but the reply is never forwarded to the VM:

root@compute:~# tcpdump -e -n -vv -i tapde7ffb39-b7
tcpdump: WARNING: tapde7ffb39-b7: no IPv4 address assigned
tcpdump: listening on tapde7ffb39-b7, link-type EN10MB (Ethernet), capture size 65535 bytes

16:18:54.614728 fa:16:3e:32:93:95 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 329: (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 315)
    0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from fa:16:3e:32:93:95, length 287, xid 0x8c595e0b, Flags [none] (0x0000)
          Client-Ethernet-Address fa:16:3e:32:93:95
          Vendor-rfc1048 Extensions
            Magic Cookie 0x63825363
            DHCP-Message Option 53, length 1: Discover
            Client-ID Option 61, length 7: ether fa:16:3e:32:93:95
            MSZ Option 57, length 2: 576
            Parameter-Request Option 55, length 9: 
              Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
              Domain-Name, MTU, BR, NTP
              Classless-Static-Route
            Vendor-Class Option 60, length 12: "udhcp 1.20.1"
            Hostname Option 12, length 3: "one"
16:18:54.615002 fa:16:3e:32:93:95 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 329: (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 315)
    0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from fa:16:3e:32:93:95, length 287, xid 0x8c595e0b, Flags [none] (0x0000)
          Client-Ethernet-Address fa:16:3e:32:93:95
          Vendor-rfc1048 Extensions
            Magic Cookie 0x63825363
            DHCP-Message Option 53, length 1: Discover
            Client-ID Option 61, length 7: ether fa:16:3e:32:93:95
            MSZ Option 57, length 2: 576
            Parameter-Request Option 55, length 9: 
              Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
              Domain-Name, MTU, BR, NTP
              Classless-Static-Route
            Vendor-Class Option 60, length 12: "udhcp 1.20.1"
            Hostname Option 12, length 3: "one"
16:18:55.066473 fa:16:3e:32:93:95 > 33:33:ff:32:93:95, ethertype IPv6 (0x86dd), length 78: (hlim 255, next-header ICMPv6 (58) payload length: 24) :: > ff02::1:ff32:9395: [icmp6 sum ok] ICMP6, neighbor solicitation, length 24, who has fe80::f816:3eff:fe32:9395

tcpdump on the that has both the VM's tap interface and the ethernet
vxlan sub-interface. DHCP request goes out and the DHCP reply comes back
but is not forwarded to the tap interface:

root@compute:~# tcpdump -e -n -vv -i brq475b2aeb-b5
tcpdump: WARNING: brq475b2aeb-b5: no IPv4 address assigned
16:18:54.614728 fa:16:3e:32:93:95 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 329: (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 315)
    0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from fa:16:3e:32:93:95, length 287, xid 0x8c595e0b, Flags [none] (0x0000)
          Client-Ethernet-Address fa:16:3e:32:93:95
          Vendor-rfc1048 Extensions
            Magic Cookie 0x63825363
            DHCP-Message Option 53, length 1: Discover
            Client-ID Option 61, length 7: ether fa:16:3e:32:93:95
            MSZ Option 57, length 2: 576
            Parameter-Request Option 55, length 9: 
              Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
              Domain-Name, MTU, BR, NTP
              Classless-Static-Route
            Vendor-Class Option 60, length 12: "udhcp 1.20.1"
            Hostname Option 12, length 3: "one"
16:18:54.614983 fa:16:3e:32:93:95 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 329: (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 315)
    0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from fa:16:3e:32:93:95, length 287, xid 0x8c595e0b, Flags [none] (0x0000)
          Client-Ethernet-Address fa:16:3e:32:93:95
          Vendor-rfc1048 Extensions
            Magic Cookie 0x63825363
            DHCP-Message Option 53, length 1: Discover
            Client-ID Option 61, length 7: ether fa:16:3e:32:93:95
            MSZ Option 57, length 2: 576
            Parameter-Request Option 55, length 9: 
              Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
              Domain-Name, MTU, BR, NTP
              Classless-Static-Route
            Vendor-Class Option 60, length 12: "udhcp 1.20.1"
            Hostname Option 12, length 3: "one"
16:18:54.615946 fa:16:3e:e3:35:28 > fa:16:3e:32:93:95, ethertype IPv4 (0x0800), length 350: (tos 0xc0, ttl 64, id 3009, offset 0, flags [none], proto UDP (17), length 336)
    10.1.0.4.67 > 10.1.0.2.68: [udp sum ok] BOOTP/DHCP, Reply, length 308, xid 0x8c595e0b, Flags [none] (0x0000)
          Your-IP 10.1.0.2
          Server-IP 10.1.0.4
          Client-Ethernet-Address fa:16:3e:32:93:95
          Vendor-rfc1048 Extensions
            Magic Cookie 0x63825363
            DHCP-Message Option 53, length 1: Offer
            Server-ID Option 54, length 4: 10.1.0.4
            Lease-Time Option 51, length 4: 86400
            RN Option 58, length 4: 43200
            RB Option 59, length 4: 75600
            Subnet-Mask Option 1, length 4: 255.255.255.240
            BR Option 28, length 4: 10.1.0.15
            Domain-Name-Server Option 6, length 4: 10.1.0.4
            Domain-Name Option 15, length 14: "openstacklocal"
            Default-Gateway Option 3, length 4: 10.1.0.1
16:18:54.616118 fa:16:3e:e5:8e:7d > fa:16:3e:32:93:95, ethertype IPv4 (0x0800), length 350: (tos 0xc0, ttl 64, id 17924, offset 0, flags [none], proto UDP (17), length 336)
    10.1.0.3.67 > 10.1.0.2.68: [udp sum ok] BOOTP/DHCP, Reply, length 308, xid 0x8c595e0b, Flags [none] (0x0000)
          Your-IP 10.1.0.2
          Server-IP 10.1.0.3
          Client-Ethernet-Address fa:16:3e:32:93:95
          Vendor-rfc1048 Extensions
            Magic Cookie 0x63825363
            DHCP-Message Option 53, length 1: Offer
            Server-ID Option 54, length 4: 10.1.0.3
            Lease-Time Option 51, length 4: 86400
            RN Option 58, length 4: 43200
            RB Option 59, length 4: 75600
            Subnet-Mask Option 1, length 4: 255.255.255.240
            BR Option 28, length 4: 10.1.0.15
            Domain-Name-Server Option 6, length 4: 10.1.0.3
            Domain-Name Option 15, length 14: "openstacklocal"
            Default-Gateway Option 3, length 4: 10.1.0.1
16:18:55.066473 fa:16:3e:32:93:95 > 33:33:ff:32:93:95, ethertype IPv6 (0x86dd), length 78: (hlim 255, next-header ICMPv6 (58) payload length: 24) :: > ff02::1:ff32:9395: [icmp6 sum ok] ICMP6, neighbor solicitation, length 24, who has fe80::f816:3eff:fe32:9395

Bridge set up on the compute node:
root@compute:~# brctl show
bridge name     bridge id               STP enabled     interfaces
brq475b2aeb-b5          8000.b60ebc22e312       no              tapde7ffb39-b7
                                                        vxlan-100
virbr0          8000.000000000000       yes


ml2 config file:
[ml2]

type_drivers = flat,vxlan
tenant_network_types = flat,vxlan
mechanism_drivers = linuxbridge
[ml2_type_flat]
flat_networks = *

[ml2_type_vlan]
[ml2_type_gre]
[ml2_type_vxlan]
vni_ranges = 100:200
vxlan_group = 224.0.0.1

[securitygroup]
firewall_driver = neutron.agent.linux.iptables_firewall.IptablesFirewallDriver
enable_security_group = True

[agent]
tunnel_type = vxlan

[linuxbridge]
physical_interface_mappings = *:eth2

[vxlan]
enable_vxlan = True
vxlan_group = 224.0.0.1
local_ip = 10.0.2.6

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1411807

Title:
  linuxbridge using mulicast vxlan w/o l2pop fails

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  I am running Ubuntu 14.04 with a source Juno install updated as of
  yesterday. I have two network nodes and two compute nodes. When a VM
  is booted the broadcast DHCP request goes out and is received by the
  network node dnsmasq process. The unicast DHCP response is sent and is
  received by the compute node. It can be captured on the vxlan and
  Linux bridge interfaces but is never forwarded to the VM's tap
  interface which is on the bridge..

  
  tcpdump on VM's tap interface. DHCP requests go out but the reply is never forwarded to the VM:

  root@compute:~# tcpdump -e -n -vv -i tapde7ffb39-b7
  tcpdump: WARNING: tapde7ffb39-b7: no IPv4 address assigned
  tcpdump: listening on tapde7ffb39-b7, link-type EN10MB (Ethernet), capture size 65535 bytes

  16:18:54.614728 fa:16:3e:32:93:95 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 329: (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 315)
      0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from fa:16:3e:32:93:95, length 287, xid 0x8c595e0b, Flags [none] (0x0000)
            Client-Ethernet-Address fa:16:3e:32:93:95
            Vendor-rfc1048 Extensions
              Magic Cookie 0x63825363
              DHCP-Message Option 53, length 1: Discover
              Client-ID Option 61, length 7: ether fa:16:3e:32:93:95
              MSZ Option 57, length 2: 576
              Parameter-Request Option 55, length 9: 
                Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
                Domain-Name, MTU, BR, NTP
                Classless-Static-Route
              Vendor-Class Option 60, length 12: "udhcp 1.20.1"
              Hostname Option 12, length 3: "one"
  16:18:54.615002 fa:16:3e:32:93:95 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 329: (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 315)
      0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from fa:16:3e:32:93:95, length 287, xid 0x8c595e0b, Flags [none] (0x0000)
            Client-Ethernet-Address fa:16:3e:32:93:95
            Vendor-rfc1048 Extensions
              Magic Cookie 0x63825363
              DHCP-Message Option 53, length 1: Discover
              Client-ID Option 61, length 7: ether fa:16:3e:32:93:95
              MSZ Option 57, length 2: 576
              Parameter-Request Option 55, length 9: 
                Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
                Domain-Name, MTU, BR, NTP
                Classless-Static-Route
              Vendor-Class Option 60, length 12: "udhcp 1.20.1"
              Hostname Option 12, length 3: "one"
  16:18:55.066473 fa:16:3e:32:93:95 > 33:33:ff:32:93:95, ethertype IPv6 (0x86dd), length 78: (hlim 255, next-header ICMPv6 (58) payload length: 24) :: > ff02::1:ff32:9395: [icmp6 sum ok] ICMP6, neighbor solicitation, length 24, who has fe80::f816:3eff:fe32:9395

  tcpdump on the that has both the VM's tap interface and the ethernet
  vxlan sub-interface. DHCP request goes out and the DHCP reply comes
  back but is not forwarded to the tap interface:

  root@compute:~# tcpdump -e -n -vv -i brq475b2aeb-b5
  tcpdump: WARNING: brq475b2aeb-b5: no IPv4 address assigned
  16:18:54.614728 fa:16:3e:32:93:95 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 329: (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 315)
      0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from fa:16:3e:32:93:95, length 287, xid 0x8c595e0b, Flags [none] (0x0000)
            Client-Ethernet-Address fa:16:3e:32:93:95
            Vendor-rfc1048 Extensions
              Magic Cookie 0x63825363
              DHCP-Message Option 53, length 1: Discover
              Client-ID Option 61, length 7: ether fa:16:3e:32:93:95
              MSZ Option 57, length 2: 576
              Parameter-Request Option 55, length 9: 
                Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
                Domain-Name, MTU, BR, NTP
                Classless-Static-Route
              Vendor-Class Option 60, length 12: "udhcp 1.20.1"
              Hostname Option 12, length 3: "one"
  16:18:54.614983 fa:16:3e:32:93:95 > ff:ff:ff:ff:ff:ff, ethertype IPv4 (0x0800), length 329: (tos 0x0, ttl 64, id 0, offset 0, flags [none], proto UDP (17), length 315)
      0.0.0.0.68 > 255.255.255.255.67: [udp sum ok] BOOTP/DHCP, Request from fa:16:3e:32:93:95, length 287, xid 0x8c595e0b, Flags [none] (0x0000)
            Client-Ethernet-Address fa:16:3e:32:93:95
            Vendor-rfc1048 Extensions
              Magic Cookie 0x63825363
              DHCP-Message Option 53, length 1: Discover
              Client-ID Option 61, length 7: ether fa:16:3e:32:93:95
              MSZ Option 57, length 2: 576
              Parameter-Request Option 55, length 9: 
                Subnet-Mask, Default-Gateway, Domain-Name-Server, Hostname
                Domain-Name, MTU, BR, NTP
                Classless-Static-Route
              Vendor-Class Option 60, length 12: "udhcp 1.20.1"
              Hostname Option 12, length 3: "one"
  16:18:54.615946 fa:16:3e:e3:35:28 > fa:16:3e:32:93:95, ethertype IPv4 (0x0800), length 350: (tos 0xc0, ttl 64, id 3009, offset 0, flags [none], proto UDP (17), length 336)
      10.1.0.4.67 > 10.1.0.2.68: [udp sum ok] BOOTP/DHCP, Reply, length 308, xid 0x8c595e0b, Flags [none] (0x0000)
            Your-IP 10.1.0.2
            Server-IP 10.1.0.4
            Client-Ethernet-Address fa:16:3e:32:93:95
            Vendor-rfc1048 Extensions
              Magic Cookie 0x63825363
              DHCP-Message Option 53, length 1: Offer
              Server-ID Option 54, length 4: 10.1.0.4
              Lease-Time Option 51, length 4: 86400
              RN Option 58, length 4: 43200
              RB Option 59, length 4: 75600
              Subnet-Mask Option 1, length 4: 255.255.255.240
              BR Option 28, length 4: 10.1.0.15
              Domain-Name-Server Option 6, length 4: 10.1.0.4
              Domain-Name Option 15, length 14: "openstacklocal"
              Default-Gateway Option 3, length 4: 10.1.0.1
  16:18:54.616118 fa:16:3e:e5:8e:7d > fa:16:3e:32:93:95, ethertype IPv4 (0x0800), length 350: (tos 0xc0, ttl 64, id 17924, offset 0, flags [none], proto UDP (17), length 336)
      10.1.0.3.67 > 10.1.0.2.68: [udp sum ok] BOOTP/DHCP, Reply, length 308, xid 0x8c595e0b, Flags [none] (0x0000)
            Your-IP 10.1.0.2
            Server-IP 10.1.0.3
            Client-Ethernet-Address fa:16:3e:32:93:95
            Vendor-rfc1048 Extensions
              Magic Cookie 0x63825363
              DHCP-Message Option 53, length 1: Offer
              Server-ID Option 54, length 4: 10.1.0.3
              Lease-Time Option 51, length 4: 86400
              RN Option 58, length 4: 43200
              RB Option 59, length 4: 75600
              Subnet-Mask Option 1, length 4: 255.255.255.240
              BR Option 28, length 4: 10.1.0.15
              Domain-Name-Server Option 6, length 4: 10.1.0.3
              Domain-Name Option 15, length 14: "openstacklocal"
              Default-Gateway Option 3, length 4: 10.1.0.1
  16:18:55.066473 fa:16:3e:32:93:95 > 33:33:ff:32:93:95, ethertype IPv6 (0x86dd), length 78: (hlim 255, next-header ICMPv6 (58) payload length: 24) :: > ff02::1:ff32:9395: [icmp6 sum ok] ICMP6, neighbor solicitation, length 24, who has fe80::f816:3eff:fe32:9395

  Bridge set up on the compute node:
  root@compute:~# brctl show
  bridge name     bridge id               STP enabled     interfaces
  brq475b2aeb-b5          8000.b60ebc22e312       no              tapde7ffb39-b7
                                                          vxlan-100
  virbr0          8000.000000000000       yes

  
  ml2 config file:
  [ml2]

  type_drivers = flat,vxlan
  tenant_network_types = flat,vxlan
  mechanism_drivers = linuxbridge
  [ml2_type_flat]
  flat_networks = *

  [ml2_type_vlan]
  [ml2_type_gre]
  [ml2_type_vxlan]
  vni_ranges = 100:200
  vxlan_group = 224.0.0.1

  [securitygroup]
  firewall_driver = neutron.agent.linux.iptables_firewall.IptablesFirewallDriver
  enable_security_group = True

  [agent]
  tunnel_type = vxlan

  [linuxbridge]
  physical_interface_mappings = *:eth2

  [vxlan]
  enable_vxlan = True
  vxlan_group = 224.0.0.1
  local_ip = 10.0.2.6

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1411807/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next