← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #36771

[Bug 1483875] [NEW] FWaaS - firewall deleted unexpectedly by agent

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

q-svc log entries

2015-08-11 18:16:06.041 WARNING
neutron_fwaas.services.firewall.fwaas_plugin [req-
9e82a535-e233-4190-8bb2-d40476291cd0 FWaaSExtensionTestJSON-1654170307
FWaaSExtensionTestJSON-582089387] Firewall 2d586bfd-a8ae-431d-b88b-
7169520de59d unexpectedly deleted by agent, status was ACTIVE

q-agt log:

2015-08-11 18:17:29.409 10414 DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ip', 'netns', 'exec', 'qrouter-543f9f00-3b3e-4683-8659-8fb6b4a986a8', 'ip', '-6', 'route', 'replace', 'default', 'via', '2001:db8::2', 'dev', 'qg-bfc277d3-a2'] execute_rootwrap_daemon /opt/stack/new/neutron/neutron/agent/linux/utils.py:101
2015-08-11 18:17:29.449 DEBUG neutron.agent.l3.agent [req-5784cb5d-5ca4-4fa2-b804-e6a7acf8eec2 RoutersIpV6Test-1482608198 RoutersIpV6Test-1725884989] Got routers updated notification :[u'8b0f2f15-c8b4-4bc2-9e74-d713b7acb917'] routers_updated /opt/stack/new/neutron/neutron/agent/l3/agent.py:371
2015-08-11 18:17:29.450 10414 DEBUG neutron.agent.l3.agent [-] Starting router update for 8b0f2f15-c8b4-4bc2-9e74-d713b7acb917, action None, priority 0 _process_router_update /opt/stack/new/neutron/neutron/agent/l3/agent.py:442
2015-08-11 18:17:29.450 10414 DEBUG oslo_messaging._drivers.amqpdriver [-] MSG_ID is 1b13de7d03104d96b4324b5328454e3d _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:392
2015-08-11 18:17:29.452 DEBUG neutron_fwaas.services.firewall.drivers.linux.iptables_fwaas [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Updating firewall 2d586bfd-a8ae-431d-b88b-7169520de59d for tenant 0c0cac5e07754eb1be4d747a6865ccee) update_firewall /opt/stack/new/neutron-fwaas/neutron_fwaas/services/firewall/drivers/linux/iptables_fwaas.py:112
2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain iv42d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain ov42d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain iv62d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain ov62d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
2015-08-11 18:17:29.453 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain fwaas-defau which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
2015-08-11 18:17:29.453 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain fwaas-defau which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170


Kibana query:

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwidGVhckRvd25DbGFzcyAobmV1dHJvbi50ZXN0cy5hcGkudGVzdF9md2Fhc19leHRlbnNpb25zLkZXYWFTRXh0ZW5zaW9uVGVzdEpTT04pXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjQzMjAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQzOTMyMjE4Nzg0M30=

** Affects: neutron
     Importance: Undecided
         Status: New


** Tags: fwaas

** Tags added: fwaas

** Description changed:

  q-svc log entries
- 2015-08-11 18:16:06.041 WARNING neutron_fwaas.services.firewall.fwaas_plugin [req-9e82a535-e233-4190-8bb2-d40476291cd0 FWaaSExtensionTestJSON-1654170307 FWaaSExtensionTestJSON-582089387] Firewall 2d586bfd-a8ae-431d-b88b-7169520de59d unexpectedly deleted by agent, status was ACTIVE
+ 
+ 2015-08-11 18:16:06.041 WARNING
+ neutron_fwaas.services.firewall.fwaas_plugin [req-
+ 9e82a535-e233-4190-8bb2-d40476291cd0 FWaaSExtensionTestJSON-1654170307
+ FWaaSExtensionTestJSON-582089387] Firewall 2d586bfd-a8ae-431d-b88b-
+ 7169520de59d unexpectedly deleted by agent, status was ACTIVE
  
  q-agt log:
  
- http://paste.openstack.org/show/412604/
+ 2015-08-11 18:17:29.409 10414 DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ip', 'netns', 'exec', 'qrouter-543f9f00-3b3e-4683-8659-8fb6b4a986a8', 'ip', '-6', 'route', 'replace', 'default', 'via', '2001:db8::2', 'dev', 'qg-bfc277d3-a2'] execute_rootwrap_daemon /opt/stack/new/neutron/neutron/agent/linux/utils.py:101
+ 2015-08-11 18:17:29.449 DEBUG neutron.agent.l3.agent [req-5784cb5d-5ca4-4fa2-b804-e6a7acf8eec2 RoutersIpV6Test-1482608198 RoutersIpV6Test-1725884989] Got routers updated notification :[u'8b0f2f15-c8b4-4bc2-9e74-d713b7acb917'] routers_updated /opt/stack/new/neutron/neutron/agent/l3/agent.py:371
+ 2015-08-11 18:17:29.450 10414 DEBUG neutron.agent.l3.agent [-] Starting router update for 8b0f2f15-c8b4-4bc2-9e74-d713b7acb917, action None, priority 0 _process_router_update /opt/stack/new/neutron/neutron/agent/l3/agent.py:442
+ 2015-08-11 18:17:29.450 10414 DEBUG oslo_messaging._drivers.amqpdriver [-] MSG_ID is 1b13de7d03104d96b4324b5328454e3d _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:392
+ 2015-08-11 18:17:29.452 DEBUG neutron_fwaas.services.firewall.drivers.linux.iptables_fwaas [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Updating firewall 2d586bfd-a8ae-431d-b88b-7169520de59d for tenant 0c0cac5e07754eb1be4d747a6865ccee) update_firewall /opt/stack/new/neutron-fwaas/neutron_fwaas/services/firewall/drivers/linux/iptables_fwaas.py:112
+ 2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain iv42d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
+ 2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain ov42d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
+ 2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain iv62d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
+ 2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain ov62d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
+ 2015-08-11 18:17:29.453 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain fwaas-defau which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
+ 2015-08-11 18:17:29.453 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain fwaas-defau which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170

** Description changed:

  q-svc log entries
  
  2015-08-11 18:16:06.041 WARNING
  neutron_fwaas.services.firewall.fwaas_plugin [req-
  9e82a535-e233-4190-8bb2-d40476291cd0 FWaaSExtensionTestJSON-1654170307
  FWaaSExtensionTestJSON-582089387] Firewall 2d586bfd-a8ae-431d-b88b-
  7169520de59d unexpectedly deleted by agent, status was ACTIVE
  
  q-agt log:
  
  2015-08-11 18:17:29.409 10414 DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ip', 'netns', 'exec', 'qrouter-543f9f00-3b3e-4683-8659-8fb6b4a986a8', 'ip', '-6', 'route', 'replace', 'default', 'via', '2001:db8::2', 'dev', 'qg-bfc277d3-a2'] execute_rootwrap_daemon /opt/stack/new/neutron/neutron/agent/linux/utils.py:101
  2015-08-11 18:17:29.449 DEBUG neutron.agent.l3.agent [req-5784cb5d-5ca4-4fa2-b804-e6a7acf8eec2 RoutersIpV6Test-1482608198 RoutersIpV6Test-1725884989] Got routers updated notification :[u'8b0f2f15-c8b4-4bc2-9e74-d713b7acb917'] routers_updated /opt/stack/new/neutron/neutron/agent/l3/agent.py:371
  2015-08-11 18:17:29.450 10414 DEBUG neutron.agent.l3.agent [-] Starting router update for 8b0f2f15-c8b4-4bc2-9e74-d713b7acb917, action None, priority 0 _process_router_update /opt/stack/new/neutron/neutron/agent/l3/agent.py:442
  2015-08-11 18:17:29.450 10414 DEBUG oslo_messaging._drivers.amqpdriver [-] MSG_ID is 1b13de7d03104d96b4324b5328454e3d _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:392
  2015-08-11 18:17:29.452 DEBUG neutron_fwaas.services.firewall.drivers.linux.iptables_fwaas [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Updating firewall 2d586bfd-a8ae-431d-b88b-7169520de59d for tenant 0c0cac5e07754eb1be4d747a6865ccee) update_firewall /opt/stack/new/neutron-fwaas/neutron_fwaas/services/firewall/drivers/linux/iptables_fwaas.py:112
  2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain iv42d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain ov42d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain iv62d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain ov62d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.453 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain fwaas-defau which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.453 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain fwaas-defau which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
+ 
+ 
+ Kibana query:
+ 
+ http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwidGVhckRvd25DbGFzcyAobmV1dHJvbi50ZXN0cy5hcGkudGVzdF9md2Fhc19leHRlbnNpb25zLkZXYWFTRXh0ZW5zaW9uVGVzdEpTT04pXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjQzMjAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQzOTMyMjE4Nzg0M30=

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1483875

Title:
  FWaaS - firewall deleted unexpectedly by agent

Status in neutron:
  New

Bug description:
  q-svc log entries

  2015-08-11 18:16:06.041 WARNING
  neutron_fwaas.services.firewall.fwaas_plugin [req-
  9e82a535-e233-4190-8bb2-d40476291cd0 FWaaSExtensionTestJSON-1654170307
  FWaaSExtensionTestJSON-582089387] Firewall 2d586bfd-a8ae-431d-b88b-
  7169520de59d unexpectedly deleted by agent, status was ACTIVE

  q-agt log:

  2015-08-11 18:17:29.409 10414 DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ip', 'netns', 'exec', 'qrouter-543f9f00-3b3e-4683-8659-8fb6b4a986a8', 'ip', '-6', 'route', 'replace', 'default', 'via', '2001:db8::2', 'dev', 'qg-bfc277d3-a2'] execute_rootwrap_daemon /opt/stack/new/neutron/neutron/agent/linux/utils.py:101
  2015-08-11 18:17:29.449 DEBUG neutron.agent.l3.agent [req-5784cb5d-5ca4-4fa2-b804-e6a7acf8eec2 RoutersIpV6Test-1482608198 RoutersIpV6Test-1725884989] Got routers updated notification :[u'8b0f2f15-c8b4-4bc2-9e74-d713b7acb917'] routers_updated /opt/stack/new/neutron/neutron/agent/l3/agent.py:371
  2015-08-11 18:17:29.450 10414 DEBUG neutron.agent.l3.agent [-] Starting router update for 8b0f2f15-c8b4-4bc2-9e74-d713b7acb917, action None, priority 0 _process_router_update /opt/stack/new/neutron/neutron/agent/l3/agent.py:442
  2015-08-11 18:17:29.450 10414 DEBUG oslo_messaging._drivers.amqpdriver [-] MSG_ID is 1b13de7d03104d96b4324b5328454e3d _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:392
  2015-08-11 18:17:29.452 DEBUG neutron_fwaas.services.firewall.drivers.linux.iptables_fwaas [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Updating firewall 2d586bfd-a8ae-431d-b88b-7169520de59d for tenant 0c0cac5e07754eb1be4d747a6865ccee) update_firewall /opt/stack/new/neutron-fwaas/neutron_fwaas/services/firewall/drivers/linux/iptables_fwaas.py:112
  2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain iv42d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain ov42d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain iv62d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.452 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain ov62d586bfd which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.453 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain fwaas-defau which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170
  2015-08-11 18:17:29.453 DEBUG neutron.agent.linux.iptables_manager [req-c8ebb00d-2415-4b8d-b647-2a1efd1f0fbb None None] Attempted to remove chain fwaas-defau which does not exist remove_chain /opt/stack/new/neutron/neutron/agent/linux/iptables_manager.py:170

  
  Kibana query:

  http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwidGVhckRvd25DbGFzcyAobmV1dHJvbi50ZXN0cy5hcGkudGVzdF9md2Fhc19leHRlbnNpb25zLkZXYWFTRXh0ZW5zaW9uVGVzdEpTT04pXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjQzMjAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQzOTMyMjE4Nzg0M30=

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1483875/+subscriptions

Follow ups

  Thread Previous • Date Previous • • Thread Next