yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1603383] [NEW] [stable/liberty] LBaaS v2 haproxy: collect_stats task periodically running on LB without any pool/members

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Prashant Shetty <prashantshetty@xxxxxxxxxx>
Date: Fri, 15 Jul 2016 10:19:10 -0000
Reply-to: Bug 1603383 <1603383@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Just noticed that collect_stats task is periodically running every 10 sec on LB which doesn’t have any pool/members. 
Its flooding logs and may be we can check LB for its pool/member before collecting stats.

Logs:

root@runner:/home/stack/nsbu_cqe_openstack# neutron lbaas-loadbalancer-list
+--------------------------------------+---------+-------------+---------------------+----------+
| id                                   | name    | vip_address | provisioning_status | provider |
+--------------------------------------+---------+-------------+---------------------+----------+
| 0c1c2b2b-e693-48c2-9351-9804dcfb4a25 | test-lb | 20.0.0.3    | ACTIVE              | haproxy  |
+--------------------------------------+---------+-------------+---------------------+----------+
root@runner:/home/stack/nsbu_cqe_openstack# neutron lbaas-pool-list

root@runner:/home/stack/nsbu_cqe_openstack#

2016-06-23 11:49:37.628 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:49:47.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:49:47.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:49:57.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:49:57.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:50:07.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:50:07.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:50:17.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:50:17.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:50:27.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:50:27.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:50:27.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.periodic_resync from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:50:37.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:50:37.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:50:47.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:50:47.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:50:57.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:50:57.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:51:07.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:51:07.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:51:17.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:51:17.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:51:27.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:51:27.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:51:27.630 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.periodic_resync from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:51:37.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:51:37.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:51:47.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
2016-06-23 11:51:47.630 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
2016-06-23 11:51:57.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213

** Affects: neutron
     Importance: Undecided
         Status: New


** Tags: lbaas

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1603383

Title:
  [stable/liberty] LBaaS v2 haproxy:  collect_stats task periodically
  running on LB without any pool/members

Status in neutron:
  New

Bug description:
  Just noticed that collect_stats task is periodically running every 10 sec on LB which doesn’t have any pool/members. 
  Its flooding logs and may be we can check LB for its pool/member before collecting stats.

  Logs:

  root@runner:/home/stack/nsbu_cqe_openstack# neutron lbaas-loadbalancer-list
  +--------------------------------------+---------+-------------+---------------------+----------+
  | id                                   | name    | vip_address | provisioning_status | provider |
  +--------------------------------------+---------+-------------+---------------------+----------+
  | 0c1c2b2b-e693-48c2-9351-9804dcfb4a25 | test-lb | 20.0.0.3    | ACTIVE              | haproxy  |
  +--------------------------------------+---------+-------------+---------------------+----------+
  root@runner:/home/stack/nsbu_cqe_openstack# neutron lbaas-pool-list

  root@runner:/home/stack/nsbu_cqe_openstack#

  2016-06-23 11:49:37.628 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:49:47.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:49:47.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:49:57.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:49:57.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:50:07.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:50:07.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:50:17.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:50:17.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:50:27.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:50:27.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:50:27.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.periodic_resync from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:50:37.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:50:37.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:50:47.628 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:50:47.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:50:57.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:50:57.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:51:07.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:51:07.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:51:17.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:51:17.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:51:27.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:51:27.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:51:27.630 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.periodic_resync from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:51:37.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:51:37.629 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:51:47.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213
  2016-06-23 11:51:47.630 WARNING neutron_lbaas.drivers.haproxy.namespace_driver [-] Stats socket not found for loadbalancer 0c1c2b2b-e693-48c2-9351-9804dcfb4a25
  2016-06-23 11:51:57.629 DEBUG oslo_service.periodic_task [-] Running periodic task LbaasAgentManager.collect_stats from (pid=5316) run_periodic_tasks /usr/local/lib/python2.7/dist-packages/oslo_service/periodic_task.py:213

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1603383/+subscriptions