yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1838697] Re: DVR Mac conversion rules are only added for the first router a network is attached to

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Launchpad Bug Tracker <1838697@xxxxxxxxxxxxxxxxxx>
Date: Wed, 02 Oct 2019 04:17:26 -0000
Reply-to: Bug 1838697 <1838697@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
[Expired for neutron because there has been no activity for 60 days.]

** Changed in: neutron
       Status: Incomplete => Expired

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1838697

Title:
  DVR Mac conversion rules are only added for the first router a network
  is attached to

Status in neutron:
  Expired

Bug description:
  This is seen on stable/pike, have not checked latest or stein.

  1. Create a basic tenant network and create a DVR router, attach them.
  Spin up some VMs:

  [root@xxxxxxxxxxxxxxxxxxxxxxxxxxxxx arjun(admin)]# openstack port list --network 8cd0e19e-9041-4a62-9cc9-6bfb5b10f955 --long
  +--------------------------------------+------+-------------------+----------------------------------------------------------------------------+--------+--------------------------------------+--------------------------------------+------+
  | ID                                   | Name | MAC Address       | Fixed IP Addresses                                                         | Status | Security Groups                      | Device Owner                         | Tags |
  +--------------------------------------+------+-------------------+----------------------------------------------------------------------------+--------+--------------------------------------+--------------------------------------+------+
  | 16e971ae-0ce9-4f4a-aaab-6ab3fc71bf93 |      | fa:16:3e:79:66:c8 | ip_address='10.23.23.9', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | 1ef66f53-7818-4281-b407-9be7d55b3b17 |      | fa:16:3e:ce:f8:cd | ip_address='10.23.23.7', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | 21553560-5491-4036-9d03-65d7bedb28dc |      | fa:16:3e:0a:ff:1b | ip_address='10.23.23.2', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE |                                      | network:dhcp                         |      |
  | 386d3d98-6c86-4748-9c2e-8b60fbe3f6cc |      | fa:16:3e:c9:19:14 | ip_address='10.23.23.25', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8' | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | 7be10a79-e581-4ba9-95c9-870e845dbea0 |      | fa:16:3e:0b:9b:e3 | ip_address='10.23.23.28', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8' | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | be9d8d83-0c55-49aa-836e-bb4f483bde48 |      | fa:16:3e:21:76:67 | ip_address='10.23.23.4', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE |                                      | network:dhcp                         |      |
  | d266f85c-14b1-4c47-a357-44cd0fa4b557 |      | fa:16:3e:c4:f0:ce | ip_address='10.23.23.3', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE |                                      | network:dhcp                         |      |
  | de2fb0b6-9756-4418-8501-be202afbf006 |      | fa:16:3e:e7:f6:6c | ip_address='10.23.23.14', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8' | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | f00fa134-da4d-4663-8d94-52de0840f9d4 |      | fa:16:3e:2e:3c:8a | ip_address='10.23.23.5', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | f33d9ba4-cfdc-42f3-aff4-e5221f84ac03 |      | fa:16:3e:c9:86:97 | ip_address='10.23.23.6', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | f763ba3f-fae2-4608-8ef9-10ccc023eacc |      | fa:16:3e:5c:44:da | ip_address='10.23.23.1', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE |                                      | network:router_interface_distributed |      |
  +--------------------------------------+------+-------------------+----------------------------------------------------------------------------+--------+--------------------------------------+--------------------------------------+------+

  2. Check on a host where one of the VMs is. Search for the router
  port's MAC in br-int. For inbound packets (arriving from br-tun),
  there is a table=1 rule that converts from remote per-host DVR MAC to
  the common MAC of the network:router_distributed port:

  
  [root@chef ~]# ovs-ofctl dump-flows br-int | grep fa:16:3e:5c:44:da
   cookie=0xbdf055421ffc2398, duration=256.770s, table=1, n_packets=0, n_bytes=0, idle_age=1877, priority=4,dl_vlan=13,dl_dst=fa:16:3e:ce:f8:cd actions=mod_dl_src:fa:16:3e:5c:44:da,resubmit(,60)


  3. Now create a 2nd router. Attach the same network to this router.
  Now notice this network has 2 network:router_interface_distributed
  ports. But the DVR MAC conversion rules are missing for this other
  router MAC. Only first one is present:

  [root@xxxxxxxxxxxxxxxxxxxxxxxxxxxxx arjun(admin)]# openstack port list --network 8cd0e19e-9041-4a62-9cc9-6bfb5b10f955 --long
  +--------------------------------------+------+-------------------+-----------------------------------------------------------------------------+--------+--------------------------------------+--------------------------------------+------+
  | ID                                   | Name | MAC Address       | Fixed IP Addresses                                                          | Status | Security Groups                      | Device Owner                         | Tags |
  +--------------------------------------+------+-------------------+-----------------------------------------------------------------------------+--------+--------------------------------------+--------------------------------------+------+
  | 16e971ae-0ce9-4f4a-aaab-6ab3fc71bf93 |      | fa:16:3e:79:66:c8 | ip_address='10.23.23.9', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'   | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | 1ef66f53-7818-4281-b407-9be7d55b3b17 |      | fa:16:3e:ce:f8:cd | ip_address='10.23.23.7', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'   | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | 21553560-5491-4036-9d03-65d7bedb28dc |      | fa:16:3e:0a:ff:1b | ip_address='10.23.23.2', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'   | ACTIVE |                                      | network:dhcp                         |      |
  | 386d3d98-6c86-4748-9c2e-8b60fbe3f6cc |      | fa:16:3e:c9:19:14 | ip_address='10.23.23.25', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | 4e211475-91e0-4627-8342-837210219fbc |      | fa:16:3e:19:67:9e | ip_address='10.23.23.199', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8' | ACTIVE | ecd04202-0111-4e29-8e2f-39a203123c75 | network:router_interface_distributed |      |
  | 7be10a79-e581-4ba9-95c9-870e845dbea0 |      | fa:16:3e:0b:9b:e3 | ip_address='10.23.23.28', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | be9d8d83-0c55-49aa-836e-bb4f483bde48 |      | fa:16:3e:21:76:67 | ip_address='10.23.23.4', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'   | ACTIVE |                                      | network:dhcp                         |      |
  | d266f85c-14b1-4c47-a357-44cd0fa4b557 |      | fa:16:3e:c4:f0:ce | ip_address='10.23.23.3', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'   | ACTIVE |                                      | network:dhcp                         |      |
  | de2fb0b6-9756-4418-8501-be202afbf006 |      | fa:16:3e:e7:f6:6c | ip_address='10.23.23.14', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'  | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | f00fa134-da4d-4663-8d94-52de0840f9d4 |      | fa:16:3e:2e:3c:8a | ip_address='10.23.23.5', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'   | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | f33d9ba4-cfdc-42f3-aff4-e5221f84ac03 |      | fa:16:3e:c9:86:97 | ip_address='10.23.23.6', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'   | ACTIVE | bd5274ad-2ff9-443a-9226-473cf129e915 | compute:None                         |      |
  | f763ba3f-fae2-4608-8ef9-10ccc023eacc |      | fa:16:3e:5c:44:da | ip_address='10.23.23.1', subnet_id='f012101e-91ac-4b85-947e-0f9eca83d5e8'   | ACTIVE |                                      | network:router_interface_distributed |      |
  +--------------------------------------+------+-------------------+-----------------------------------------------------------------------------+--------+--------------------------------------+--------------------------------------+------+

  [root@chef ~]# ovs-ofctl dump-flows br-int | grep fa:16:3e:19:67:9e
  [root@chef ~]# ovs-ofctl dump-flows br-int | grep fa:16:3e:5c:44:da
   cookie=0xbdf055421ffc2398, duration=256.770s, table=1, n_packets=0, n_bytes=0, idle_age=1877, priority=4,dl_vlan=13,dl_dst=fa:16:3e:ce:f8:cd actions=mod_dl_src:fa:16:3e:5c:44:da,resubmit(,60)

  
  Is this expected?

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1838697/+subscriptions
References

[Bug 1838697] [NEW] DVR Mac conversion rules are only added for the first router a network is attached to
From: Arjun Baindur, 2019-08-01