← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1450982] [NEW] DVR: Router Gateway Port cannot be delted in certain circumstances

 

Public bug reported:

Tests have show that following sequence of events on a multinode setup causes the network:floatingip_agent_gateway port to be left hanging around. It is not possible to delete this port from the cli, even with admin powers.  Restackings seems to be the only solution. 
The problem is furthered complicated because any public network which has the left over port as one of its meembers  may not be deleted.
Here is the list of steps to reproduce. All must be done with admin power under admin tenant


#+ Test Steps: Get ip address of all nodes
#+ Test Steps:
#+ Step: User, Tenant, Token, and Image Verification
#+ Step: Add security Rules
#+ Step: Router Creations(DVR)
#+ Step: Networks, and Subnet Attachement
#+ Step: spin up vms
#+ Step: Obtain necessary vm information
#+ Step: Create external Network and Subnet
#+ Step: Attach external network to router
#+ Step: Associate FIPs to Vm - 2 RESTfull
#+ Step: Verify floating ip pluming
#+ Step: Verify connectivity to vms from outside world
#+ Step: Verify connectivity to vms from outside world

04-25-2015 15:16:38 : ################################################
04-25-2015 15:16:38 :  Removing all resources from system
04-25-2015 15:16:38 : ################################################
04-25-2015 15:16:38 : ***Getting User Token***
04-25-2015 15:16:38 : ***User Token Received***
04-25-2015 15:16:38 : 
04-25-2015 15:16:38 : -- Deleting VMs
04-25-2015 15:16:39 : -- Done deleting VMs
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : -- Deleting Security Groups
04-25-2015 15:16:39 : 'default' Security Group deleted
04-25-2015 15:16:39 : -- Done deleting Security Groups
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : --- Deleting Floating IPs
04-25-2015 15:16:39 : --Done deleting Floating IPs
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : -- Clearing all routes from routers
04-25-2015 15:16:39 : -- Done Clearing all routes on routers
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : -- Detaching subnets from routers
04-25-2015 15:16:39 : -- Done detaching subnets from routers
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : -- Deleting Ports
HTTP Error 409: Conflict
04-25-2015 15:16:39 : Error deleting 25337691-d558-46d8-b2a2-96cbdef198db
04-25-2015 15:16:39 : -- Done deleting ports
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : -- Deleting subnets
HTTP Error 409: Conflict
04-25-2015 15:16:39 : Error deleting 1f4059ee-2b6b-48d0-9687-b7e0fead3cae
04-25-2015 15:16:39 : --Done deleting subnets
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : -- Deleting routers
04-25-2015 15:16:39 : --Done deleting routers
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : --Deleting networks
HTTP Error 409: Conflict
04-25-2015 15:16:39 : Error deleting wjs_public_network
04-25-2015 15:16:39 : -- Done deleting networks
04-25-2015 15:16:39 : 
04-25-2015 15:16:39 : ------DONE-------


adolfo@devstack:~/dvr$ neutron port-list 
+--------------------------------------+------+-------------------+------------------------------------------------------------------------------------+
| id                                   | name | mac_address       | fixed_ips                                                                          |
+--------------------------------------+------+-------------------+------------------------------------------------------------------------------------+
| 25337691-d558-46d8-b2a2-96cbdef198db |      | fa:16:3e:06:1c:0e | {"subnet_id": "1f4059ee-2b6b-48d0-9687-b7e0fead3cae", "ip_address": "101.0.0.103"} |
+--------------------------------------+------+-------------------+------------------------------------------------------------------------------------+
adolfo@devstack:~/dvr$ neutron port-show 25337691-d558-46d8-b2a2-96cbdef198db
+-----------------------+------------------------------------------------------------------------------------+
| Field                 | Value                                                                              |
+-----------------------+------------------------------------------------------------------------------------+
| admin_state_up        | True                                                                               |
| allowed_address_pairs |                                                                                    |
| binding:host_id       | devstack                                                                           |
| binding:profile       | {}                                                                                 |
| binding:vif_details   | {"port_filter": true, "ovs_hybrid_plug": true}                                     |
| binding:vif_type      | ovs                                                                                |
| binding:vnic_type     | normal                                                                             |
| device_id             | d87ddfd4-6acc-48c7-8d0d-9119d6531eb2                                               |
| device_owner          | network:floatingip_agent_gateway                                                   |
| extra_dhcp_opts       |                                                                                    |
| fixed_ips             | {"subnet_id": "1f4059ee-2b6b-48d0-9687-b7e0fead3cae", "ip_address": "101.0.0.103"} |
| id                    | 25337691-d558-46d8-b2a2-96cbdef198db                                               |
| mac_address           | fa:16:3e:06:1c:0e                                                                  |
| name                  |                                                                                    |
| network_id            | b376c1a7-ecfa-4892-88dc-509145e7fbc7                                               |
| security_groups       |                                                                                    |
| status                | DOWN                                                                               |
| tenant_id             |                                                                                    |
+-----------------------+------------------------------------------------------------------------------------+


adolfo@devstack:~/dvr$ neutron net-list 
+--------------------------------------+--------------------+---------------------------------------------------+
| id                                   | name               | subnets                                           |
+--------------------------------------+--------------------+---------------------------------------------------+
| b376c1a7-ecfa-4892-88dc-509145e7fbc7 | wjs_public_network | 1f4059ee-2b6b-48d0-9687-b7e0fead3cae 101.0.0.0/24 |
+--------------------------------------+--------------------+---------------------------------------------------+
adolfo@devstack:~/dvr$

** Affects: neutron
     Importance: Undecided
     Assignee: Adolfo Duarte (adolfo-duarte)
         Status: New

** Changed in: neutron
     Assignee: (unassigned) => Adolfo Duarte (adolfo-duarte)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1450982

Title:
  DVR: Router Gateway Port   cannot be delted in certain circumstances

Status in OpenStack Neutron (virtual network service):
  New

Bug description:
  Tests have show that following sequence of events on a multinode setup causes the network:floatingip_agent_gateway port to be left hanging around. It is not possible to delete this port from the cli, even with admin powers.  Restackings seems to be the only solution. 
  The problem is furthered complicated because any public network which has the left over port as one of its meembers  may not be deleted.
  Here is the list of steps to reproduce. All must be done with admin power under admin tenant


  #+ Test Steps: Get ip address of all nodes
  #+ Test Steps:
  #+ Step: User, Tenant, Token, and Image Verification
  #+ Step: Add security Rules
  #+ Step: Router Creations(DVR)
  #+ Step: Networks, and Subnet Attachement
  #+ Step: spin up vms
  #+ Step: Obtain necessary vm information
  #+ Step: Create external Network and Subnet
  #+ Step: Attach external network to router
  #+ Step: Associate FIPs to Vm - 2 RESTfull
  #+ Step: Verify floating ip pluming
  #+ Step: Verify connectivity to vms from outside world
  #+ Step: Verify connectivity to vms from outside world

  04-25-2015 15:16:38 : ################################################
  04-25-2015 15:16:38 :  Removing all resources from system
  04-25-2015 15:16:38 : ################################################
  04-25-2015 15:16:38 : ***Getting User Token***
  04-25-2015 15:16:38 : ***User Token Received***
  04-25-2015 15:16:38 : 
  04-25-2015 15:16:38 : -- Deleting VMs
  04-25-2015 15:16:39 : -- Done deleting VMs
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : -- Deleting Security Groups
  04-25-2015 15:16:39 : 'default' Security Group deleted
  04-25-2015 15:16:39 : -- Done deleting Security Groups
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : --- Deleting Floating IPs
  04-25-2015 15:16:39 : --Done deleting Floating IPs
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : -- Clearing all routes from routers
  04-25-2015 15:16:39 : -- Done Clearing all routes on routers
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : -- Detaching subnets from routers
  04-25-2015 15:16:39 : -- Done detaching subnets from routers
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : -- Deleting Ports
  HTTP Error 409: Conflict
  04-25-2015 15:16:39 : Error deleting 25337691-d558-46d8-b2a2-96cbdef198db
  04-25-2015 15:16:39 : -- Done deleting ports
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : -- Deleting subnets
  HTTP Error 409: Conflict
  04-25-2015 15:16:39 : Error deleting 1f4059ee-2b6b-48d0-9687-b7e0fead3cae
  04-25-2015 15:16:39 : --Done deleting subnets
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : -- Deleting routers
  04-25-2015 15:16:39 : --Done deleting routers
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : --Deleting networks
  HTTP Error 409: Conflict
  04-25-2015 15:16:39 : Error deleting wjs_public_network
  04-25-2015 15:16:39 : -- Done deleting networks
  04-25-2015 15:16:39 : 
  04-25-2015 15:16:39 : ------DONE-------


  adolfo@devstack:~/dvr$ neutron port-list 
  +--------------------------------------+------+-------------------+------------------------------------------------------------------------------------+
  | id                                   | name | mac_address       | fixed_ips                                                                          |
  +--------------------------------------+------+-------------------+------------------------------------------------------------------------------------+
  | 25337691-d558-46d8-b2a2-96cbdef198db |      | fa:16:3e:06:1c:0e | {"subnet_id": "1f4059ee-2b6b-48d0-9687-b7e0fead3cae", "ip_address": "101.0.0.103"} |
  +--------------------------------------+------+-------------------+------------------------------------------------------------------------------------+
  adolfo@devstack:~/dvr$ neutron port-show 25337691-d558-46d8-b2a2-96cbdef198db
  +-----------------------+------------------------------------------------------------------------------------+
  | Field                 | Value                                                                              |
  +-----------------------+------------------------------------------------------------------------------------+
  | admin_state_up        | True                                                                               |
  | allowed_address_pairs |                                                                                    |
  | binding:host_id       | devstack                                                                           |
  | binding:profile       | {}                                                                                 |
  | binding:vif_details   | {"port_filter": true, "ovs_hybrid_plug": true}                                     |
  | binding:vif_type      | ovs                                                                                |
  | binding:vnic_type     | normal                                                                             |
  | device_id             | d87ddfd4-6acc-48c7-8d0d-9119d6531eb2                                               |
  | device_owner          | network:floatingip_agent_gateway                                                   |
  | extra_dhcp_opts       |                                                                                    |
  | fixed_ips             | {"subnet_id": "1f4059ee-2b6b-48d0-9687-b7e0fead3cae", "ip_address": "101.0.0.103"} |
  | id                    | 25337691-d558-46d8-b2a2-96cbdef198db                                               |
  | mac_address           | fa:16:3e:06:1c:0e                                                                  |
  | name                  |                                                                                    |
  | network_id            | b376c1a7-ecfa-4892-88dc-509145e7fbc7                                               |
  | security_groups       |                                                                                    |
  | status                | DOWN                                                                               |
  | tenant_id             |                                                                                    |
  +-----------------------+------------------------------------------------------------------------------------+

  
  adolfo@devstack:~/dvr$ neutron net-list 
  +--------------------------------------+--------------------+---------------------------------------------------+
  | id                                   | name               | subnets                                           |
  +--------------------------------------+--------------------+---------------------------------------------------+
  | b376c1a7-ecfa-4892-88dc-509145e7fbc7 | wjs_public_network | 1f4059ee-2b6b-48d0-9687-b7e0fead3cae 101.0.0.0/24 |
  +--------------------------------------+--------------------+---------------------------------------------------+
  adolfo@devstack:~/dvr$

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1450982/+subscriptions


Follow ups

References