yahoo-eng-team team mailing list archive

[liujinxin <1976439@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

ENV: stable/victoria


In a large scale cloud deployment and we have enabled DVR and have some huge virtual routers.When we remove some nodes from the cluster, the database ml2_port_binding_levels and ml2_distributed_port_bindings tables have a lot of redundant data，when restart neutron agent, especially l3 agents, neutron server side will trigger too many slow DB query. And this will cause the agent restart time to be too long to operate.

For example, the following xxx nodes have been removed from the cluster,
and there are no more qrouter on these nodes

```
MariaDB [neutron]> select count(*) from ml2_port_binding_levels;            
+----------+
| count(*) |
+----------+
|   163986 |
+----------+
MariaDB [neutron]> select count(*) from ml2_distributed_port_bindings; 
+----------+
| count(*) |
+----------+
|   119797 |
+----------+
MariaDB [neutron]> select count(*) from ml2_distributed_port_bindings where host like("%xxx%");
+----------+
| count(*) |
+----------+
|    78920 |
+----------+
MariaDB [neutron]> select count(*) from ml2_port_binding_levels where host like("%xxx%");                             
+----------+
| count(*) |
+----------+
|    79482 |
+----------+

MariaDB [neutron]> select count(distinct host) from ml2_port_binding_levels where host like("%xxx%");
+----------------------+
| count(distinct host) |
+----------------------+
|                  385 |
+----------------------+

MariaDB [neutron]> select count(*) from routers;
+----------+
| count(*) |
+----------+
|     7543 |
+----------+
```

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1976439

Title:
  The database ml2_port_binding_levels and ml2_distributed_port_bindings
  tables have a lot of redundant data

Status in neutron:
  New

Bug description:
  ENV: stable/victoria

  
  In a large scale cloud deployment and we have enabled DVR and have some huge virtual routers.When we remove some nodes from the cluster, the database ml2_port_binding_levels and ml2_distributed_port_bindings tables have a lot of redundant data，when restart neutron agent, especially l3 agents, neutron server side will trigger too many slow DB query. And this will cause the agent restart time to be too long to operate.

  For example, the following xxx nodes have been removed from the
  cluster, and there are no more qrouter on these nodes

  ```
  MariaDB [neutron]> select count(*) from ml2_port_binding_levels;            
  +----------+
  | count(*) |
  +----------+
  |   163986 |
  +----------+
  MariaDB [neutron]> select count(*) from ml2_distributed_port_bindings; 
  +----------+
  | count(*) |
  +----------+
  |   119797 |
  +----------+
  MariaDB [neutron]> select count(*) from ml2_distributed_port_bindings where host like("%xxx%");
  +----------+
  | count(*) |
  +----------+
  |    78920 |
  +----------+
  MariaDB [neutron]> select count(*) from ml2_port_binding_levels where host like("%xxx%");                             
  +----------+
  | count(*) |
  +----------+
  |    79482 |
  +----------+

  MariaDB [neutron]> select count(distinct host) from ml2_port_binding_levels where host like("%xxx%");
  +----------------------+
  | count(distinct host) |
  +----------------------+
  |                  385 |
  +----------------------+

  MariaDB [neutron]> select count(*) from routers;
  +----------+
  | count(*) |
  +----------+
  |     7543 |
  +----------+
  ```

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1976439/+subscriptions