← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 2019012] [NEW] When num of port mappings is substantial, the response time of List API so slow

 

Public bug reported:

Conditions:

I have a Victoria cluster with 1 controller node(also have
nova-compute service) and two compute node. ALL node boasts 128 CPU
cores and 512GB of memory.
I'm a  super-user. I have this problem when trying the port forwarding feature.
I established 1500 port mappings for a single floating IP A. At this
point, the response time for the "List Floating IP Port Forwardings"
API[1] becomes remarkably slow, approaching a duration of 9 minutes.

[1] https://docs.openstack.org/api-ref/network/v2/index.html#list-
floating-ip-port-forwardings


Step-by-step reproduction steps:

1. Create a floating ip

such as 10.10.16.10

2. At this time, the Port Forwarding List API response time is normal

```shell
floating_ip=10.10.16.10
openstack floating ip port forwarding list $floating_ip
```

3. create 1500 port forwarding for this floating ip

```shell
cat > creat-port-forwarding.sh << EOF
#!/bin/bash

floating_ip=10.10.16.10

source ./admin-openrc

for (( i=40000; i<40005; i++ )); do
        echo $floating_ip
        openstack floating ip port forwarding create --internal-ip-address 10.100.1.100 --port 72d49500-ba6e-4e82-bdc2-a72a836ef83e --internal-protocol-port $i --external-protocol-port $i --protocol tcp $floating_ip
done
EOF

chmod +x creat-port-forwarding.sh
./creat-port-forwarding.sh
```

4. At this point, the response time for the "List Floating IP Port Forwardings"
API becomes remarkably slow, approaching a duration of 9 minutes.

```shell
floating_ip=10.10.16.10
openstack floating ip port forwarding list $floating_ip
```

Version:
Victoria
rpm install

** Affects: neutron
     Importance: Undecided
         Status: New


** Tags: api

** Description changed:

- Pre-conditions:
+ conditions:
  I have a Victoria cluster with 1 controller node(also have
  nova-compute service) and two compute node. ALL node boasts 128 CPU
  cores and 512GB of memory.
  I'm a  super-user. I have this problem when trying the port forwarding feature.
+ I established 1500 port mappings for a single floating IP A. At this 
+ point, the response time for the "List Floating IP Port Forwardings"
+ API[1] becomes remarkably slow, approaching a duration of 9 minutes.
  
+ [1] https://docs.openstack.org/api-ref/network/v2/index.html#list-
+ floating-ip-port-forwardings
  
  Step-by-step reproduction steps:
  1. Create a floating ip
  such as 10.10.16.10
  
  2. At this time, the Port Forwarding List API response time is normal
  
  ```shell
  floating_ip=10.10.16.10
  openstack floating ip port forwarding list $floating_ip
  ```
  
  3. create 1500 port forwarding for this floating ip
  
  ```shell
  cat > creat-port-forwarding.sh << EOF
  #!/bin/bash
  
  floating_ip=10.10.16.10
  
  source ./admin-openrc
  
  for (( i=40000; i<40005; i++ )); do
-         echo $floating_ip
-         openstack floating ip port forwarding create --internal-ip-address 10.100.1.100 --port 72d49500-ba6e-4e82-bdc2-a72a836ef83e --internal-protocol-port $i --external-protocol-port $i --protocol tcp $floating_ip
+         echo $floating_ip
+         openstack floating ip port forwarding create --internal-ip-address 10.100.1.100 --port 72d49500-ba6e-4e82-bdc2-a72a836ef83e --internal-protocol-port $i --external-protocol-port $i --protocol tcp $floating_ip
  done
  EOF
  
  chmod +x creat-port-forwarding.sh
  ./creat-port-forwarding.sh
  ```
  
  4. At this point, the response time for the "List Floating IP Port Forwardings"
- API[1] becomes remarkably slow, approaching a duration of 9 minutes.
+ API becomes remarkably slow, approaching a duration of 9 minutes.
  
  ```shell
  floating_ip=10.10.16.10
  openstack floating ip port forwarding list $floating_ip
  ```
  
- [1] https://docs.openstack.org/api-ref/network/v2/index.html#list-
- floating-ip-port-forwardings
- 
- 
  Version:
  Victoria
  rpm install

** Description changed:

- conditions:
+ Conditions:
+ 
  I have a Victoria cluster with 1 controller node(also have
  nova-compute service) and two compute node. ALL node boasts 128 CPU
  cores and 512GB of memory.
  I'm a  super-user. I have this problem when trying the port forwarding feature.
- I established 1500 port mappings for a single floating IP A. At this 
+ I established 1500 port mappings for a single floating IP A. At this
  point, the response time for the "List Floating IP Port Forwardings"
  API[1] becomes remarkably slow, approaching a duration of 9 minutes.
  
  [1] https://docs.openstack.org/api-ref/network/v2/index.html#list-
  floating-ip-port-forwardings
  
+ 
  Step-by-step reproduction steps:
+ 
  1. Create a floating ip
+ 
  such as 10.10.16.10
  
  2. At this time, the Port Forwarding List API response time is normal
  
  ```shell
  floating_ip=10.10.16.10
  openstack floating ip port forwarding list $floating_ip
  ```
  
  3. create 1500 port forwarding for this floating ip
  
  ```shell
  cat > creat-port-forwarding.sh << EOF
  #!/bin/bash
  
  floating_ip=10.10.16.10
  
  source ./admin-openrc
  
  for (( i=40000; i<40005; i++ )); do
          echo $floating_ip
          openstack floating ip port forwarding create --internal-ip-address 10.100.1.100 --port 72d49500-ba6e-4e82-bdc2-a72a836ef83e --internal-protocol-port $i --external-protocol-port $i --protocol tcp $floating_ip
  done
  EOF
  
  chmod +x creat-port-forwarding.sh
  ./creat-port-forwarding.sh
  ```
  
  4. At this point, the response time for the "List Floating IP Port Forwardings"
  API becomes remarkably slow, approaching a duration of 9 minutes.
  
  ```shell
  floating_ip=10.10.16.10
  openstack floating ip port forwarding list $floating_ip
  ```
  
  Version:
  Victoria
  rpm install

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2019012

Title:
  When num of port mappings is substantial, the response time of List
  API so slow

Status in neutron:
  New

Bug description:
  Conditions:

  I have a Victoria cluster with 1 controller node(also have
  nova-compute service) and two compute node. ALL node boasts 128 CPU
  cores and 512GB of memory.
  I'm a  super-user. I have this problem when trying the port forwarding feature.
  I established 1500 port mappings for a single floating IP A. At this
  point, the response time for the "List Floating IP Port Forwardings"
  API[1] becomes remarkably slow, approaching a duration of 9 minutes.

  [1] https://docs.openstack.org/api-ref/network/v2/index.html#list-
  floating-ip-port-forwardings


  Step-by-step reproduction steps:

  1. Create a floating ip

  such as 10.10.16.10

  2. At this time, the Port Forwarding List API response time is normal

  ```shell
  floating_ip=10.10.16.10
  openstack floating ip port forwarding list $floating_ip
  ```

  3. create 1500 port forwarding for this floating ip

  ```shell
  cat > creat-port-forwarding.sh << EOF
  #!/bin/bash

  floating_ip=10.10.16.10

  source ./admin-openrc

  for (( i=40000; i<40005; i++ )); do
          echo $floating_ip
          openstack floating ip port forwarding create --internal-ip-address 10.100.1.100 --port 72d49500-ba6e-4e82-bdc2-a72a836ef83e --internal-protocol-port $i --external-protocol-port $i --protocol tcp $floating_ip
  done
  EOF

  chmod +x creat-port-forwarding.sh
  ./creat-port-forwarding.sh
  ```

  4. At this point, the response time for the "List Floating IP Port Forwardings"
  API becomes remarkably slow, approaching a duration of 9 minutes.

  ```shell
  floating_ip=10.10.16.10
  openstack floating ip port forwarding list $floating_ip
  ```

  Version:
  Victoria
  rpm install

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2019012/+subscriptions



Follow ups