yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1477348] Re: Creating a neutron lbaas pool with session persistence type HTTP_COOKIE, I could see errors in lbaasv2 screen

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Thierry Carrez <thierry.carrez+lp@xxxxxxxxx>
Date: Thu, 24 Sep 2015 07:30:28 -0000
Reply-to: Bug 1477348 <1477348@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
** Changed in: neutron
       Status: Fix Committed => Fix Released

** Changed in: neutron
    Milestone: None => liberty-rc1

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1477348

Title:
  Creating a neutron lbaas pool with session persistence type
  HTTP_COOKIE, I could see errors in lbaasv2 screen

Status in neutron:
  Fix Released

Bug description:
  HAProxy version used: 1.5

  When creating pool with session persistence type HTTP_TYPE, the pool
  is created, but could see bunch of errors shown below. Also, when
  using CURL loadbalancer ip against two backend servers with simple
  webserver, I am getting 503 error.

  neutron lbaas-pool-create --lb-algorithm ROUND_ROBIN --listener listener1 --protocol HTTP --session-persistence type=HTTP_COOKIE --name pool1
  Created a new pool:
  +---------------------+------------------------------------------------+
  | Field               | Value                                          |
  +---------------------+------------------------------------------------+
  | admin_state_up      | True                                           |
  | description         |                                                |
  | healthmonitor_id    |                                                |
  | id                  | 5a9df493-d3c7-479d-8e06-c5ced62a4af9           |
  | lb_algorithm        | ROUND_ROBIN                                    |
  | listeners           | {"id": "ef8704b6-0fc7-4566-b97b-af8b4e1cc3e2"} |
  | members             |                                                |
  | name                | pool1                                          |
  | protocol            | HTTP                                           |
  | session_persistence | {"cookie_name": null, "type": "HTTP_COOKIE"}   |
  | tenant_id           | 1d967cf6cd024efc87d0bd5a1091dc1e               |
  +---------------------+------------------------------------------------+

  2015-07-22 16:46:43.126 ERROR neutron_lbaas.agent.agent_manager [req-068a510d-3eff-4adc-b650-98fe7bc950ab admin 1d967cf6cd024efc87d0bd5a1091dc1e] Create pool 66a232b7-ca04-4cdb-abf0-842f9899c8fa failed on device driver haproxy_ns
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager Traceback (most recent call last):
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/agent/agent_manager.py", line 328, in create_pool
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     driver.pool.create(pool)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 425, in create
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     self.driver.loadbalancer.refresh(pool.listener.loadbalancer)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 370, in refresh
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     if (not self.driver.deploy_instance(loadbalancer) and
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 252, in inner
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     return f(*args, **kwargs)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 172, in deploy_instance
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     self.update(loadbalancer)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 181, in update
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     self._spawn(loadbalancer, extra_args)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 353, in _spawn
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     haproxy_base_dir)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 89, in save_config
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     haproxy_base_dir)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 221, in render_loadbalancer_obj
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     loadbalancer = _transform_loadbalancer(loadbalancer, haproxy_base_dir)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 236, in _transform_loadbalancer
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     x, haproxy_base_dir) for x in loadbalancer.listeners]
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 261, in _transform_listener
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     ret_value['default_pool'] = _transform_pool(listener.default_pool)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 299, in _transform_pool
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     pool.sessionpersistence)
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 310, in _transform_session_persistence
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager     'type': persistence.type,
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager AttributeError: 'dict' object has no attribute 'type'
  2015-07-22 16:46:43.126 TRACE neutron_lbaas.agent.agent_manager

  devstack@ubuntu:/opt/stack/neutron$ neutron lbaas-member-create  --subnet private-subnet --address 10.0.0.3 --protocol-port 80 pool1
  Created a new member:
  +----------------+--------------------------------------+
  | Field          | Value                                |
  +----------------+--------------------------------------+
  | address        | 10.0.0.4                             |
  | admin_state_up | True                                 |
  | id             | 33e2f293-d40c-4281-85ec-ae8056c51d8d |
  | protocol_port  | 80                                   |
  | subnet_id      | 57edf3b9-e2ad-4710-ad9b-64299131234f |
  | tenant_id      | 1d967cf6cd024efc87d0bd5a1091dc1e     |
  | weight         | 1                                    |
  +----------------+--------------------------------------+
  devstack@ubuntu:/opt/stack/neutron$
  devstack@ubuntu:/opt/stack/neutron$

  2015-07-22 16:47:40.987 ERROR neutron_lbaas.agent.agent_manager [req-e8081be6-9fb0-47bc-b712-fdc4f4946073 admin 1d967cf6cd024efc87d0bd5a1091dc1e] Create member 33e2f293-d40c-4281-85ec-ae8056c51d8d failed on device driver haproxy_ns
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager Traceback (most recent call last):
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/agent/agent_manager.py", line 354, in create_member
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     driver.member.create(member)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 447, in create
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     self.driver.loadbalancer.refresh(member.pool.listener.loadbalancer)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 370, in refresh
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     if (not self.driver.deploy_instance(loadbalancer) and
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 252, in inner
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     return f(*args, **kwargs)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 172, in deploy_instance
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     self.update(loadbalancer)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 181, in update
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     self._spawn(loadbalancer, extra_args)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 353, in _spawn
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     haproxy_base_dir)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 89, in save_config
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     haproxy_base_dir)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 221, in render_loadbalancer_obj
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     loadbalancer = _transform_loadbalancer(loadbalancer, haproxy_base_dir)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 236, in _transform_loadbalancer
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     x, haproxy_base_dir) for x in loadbalancer.listeners]
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 261, in _transform_listener
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     ret_value['default_pool'] = _transform_pool(listener.default_pool)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 299, in _transform_pool
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     pool.sessionpersistence)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 310, in _transform_session_persistence
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     'type': persistence.type,
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager AttributeError: 'dict' object has no attribute 'type'
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager

  devstack@ubuntu:/opt/stack/neutron$ neutron lbaas-member-create  --subnet private-subnet --address 10.0.0.3 --protocol-port 80 pool1
  Created a new member:
  +----------------+--------------------------------------+
  | Field          | Value                                |
  +----------------+--------------------------------------+
  | address        | 10.0.0.3                             |
  | admin_state_up | True                                 |
  | id             | 433091cd-2be3-4ca9-83fa-b4157e7c4351 |
  | protocol_port  | 80                                   |
  | subnet_id      | 57edf3b9-e2ad-4710-ad9b-64299131234f |
  | tenant_id      | 1d967cf6cd024efc87d0bd5a1091dc1e     |
  | weight         | 1                                    |
  +----------------+--------------------------------------+
  devstack@ubuntu:/opt/stack/neutron$

  2015-07-22 16:47:40.987 ERROR neutron_lbaas.agent.agent_manager [req-e8081be6-9fb0-47bc-b712-fdc4f4946073 admin 1d967cf6cd024efc87d0bd5a1091dc1e] Create member 433091cd-2be3-4ca9-83fa-b4157e7c4351 failed on device driver haproxy_ns
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager Traceback (most recent call last):
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/agent/agent_manager.py", line 354, in create_member
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     driver.member.create(member)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 447, in create
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     self.driver.loadbalancer.refresh(member.pool.listener.loadbalancer)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 370, in refresh
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     if (not self.driver.deploy_instance(loadbalancer) and
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py", line 252, in inner
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     return f(*args, **kwargs)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 172, in deploy_instance
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     self.update(loadbalancer)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 181, in update
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     self._spawn(loadbalancer, extra_args)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/drivers/haproxy/namespace_driver.py", line 353, in _spawn
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     haproxy_base_dir)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 89, in save_config
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     haproxy_base_dir)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 221, in render_loadbalancer_obj
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     loadbalancer = _transform_loadbalancer(loadbalancer, haproxy_base_dir)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 236, in _transform_loadbalancer
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     x, haproxy_base_dir) for x in loadbalancer.listeners]
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 261, in _transform_listener
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     ret_value['default_pool'] = _transform_pool(listener.default_pool)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 299, in _transform_pool
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     pool.sessionpersistence)
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager   File "/opt/stack/neutron-lbaas/neutron_lbaas/services/loadbalancer/drivers/haproxy/jinja_cfg.py", line 310, in _transform_session_persistence
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager     'type': persistence.type,
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager AttributeError: 'dict' object has no attribute 'type'
  2015-07-22 16:47:40.987 TRACE neutron_lbaas.agent.agent_manager

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1477348/+subscriptions
References

[Bug 1477348] [NEW] Creating a neutron lbaas pool with session persistence type HTTP_COOKIE, I could see errors in lbaasv2 screen
From: Madhusudhan Kandadai, 2015-07-23