yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1649124] [NEW] Failure to launch neutron-openvswitch-agent after tripleo deployment

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Launchpad Bug Tracker <1649124@xxxxxxxxxxxxxxxxxx>
Date: Wed, 11 Jan 2017 01:37:34 -0000
Reply-to: Bug 1649124 <1649124@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
You have been subscribed to a public bug:

Failure to launch neutron-openvswitch-agent after tripleo deployment ...
I am able to manually start it and start an overcloud deployment which
will later on fail but that's another issue.

2016-12-11 14:15:41.228 8272 INFO neutron.common.config [-] Logging enabled!
2016-12-11 14:15:41.229 8272 INFO neutron.common.config [-] /usr/bin/neutron-openvswitch-agent version 10.0.0.0b2.dev216
2016-12-11 14:15:41.234 8272 WARNING oslo_config.cfg [-] Option "rabbit_hosts" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2016-12-11 14:15:41.235 8272 WARNING oslo_config.cfg [-] Option "rabbit_password" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2016-12-11 14:15:41.235 8272 WARNING oslo_config.cfg [-] Option "rabbit_userid" from group "oslo_messaging_rabbit" is deprecated for removal.  Its value may be silently ignored in the future.
2016-12-11 14:15:41.239 8272 INFO ryu.base.app_manager [-] loading app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp
2016-12-11 14:15:41.553 8272 INFO ryu.base.app_manager [-] loading app ryu.app.ofctl.service
2016-12-11 14:15:41.555 8272 INFO ryu.base.app_manager [-] loading app ryu.controller.ofp_handler
2016-12-11 14:15:41.556 8272 INFO ryu.base.app_manager [-] instantiating app neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp of OVSNeutronAgentRyuApp
2016-12-11 14:15:41.557 8272 INFO ryu.base.app_manager [-] instantiating app ryu.controller.ofp_handler of OFPHandler
2016-12-11 14:15:41.557 8272 INFO ryu.base.app_manager [-] instantiating app ryu.app.ofctl.service of OfctlService
2016-12-11 14:15:41.583 8272 WARNING neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: send error: Connection refused
2016-12-11 14:15:41.747 8272 INFO oslo_rootwrap.client [-] Spawned new rootwrap daemon process with pid=8418
2016-12-11 14:15:51.779 8272 ERROR neutron.agent.ovsdb.impl_vsctl [-] Unable to execute ['ovs-vsctl', '--timeout=10', '--oneline', '--format=json', '--', '--id=@manager', 'create', 'Manager', 'target="ptcp:6640:127.0.0.1"', '--', 'add', 'Open_vSwitch', '.', 'manager_options', '@manager']. Exception: Exit code: -14; Stdin: ; Stdout: ; Stderr: 2016-12-11T19:15:51Z|00002|fatal_signal|WARN|terminating with signal 14 (Alarm clock)

2016-12-11 14:15:51.849 8272 INFO neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: connecting...
2016-12-11 14:15:51.849 8272 INFO neutron.agent.ovsdb.native.vlog [-] tcp:127.0.0.1:6640: connected
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp [-] Agent main thread died of an exception
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp Traceback (most recent call last):
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/openflow/native/ovs_ryuapp.py", line 42, in agent_main_wrapper
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp     ovs_agent.main(bridge_classes)
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 2149, in main
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp     agent = OVSNeutronAgent(bridge_classes, cfg.CONF)
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 169, in __init__
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp     self.setup_integration_br()
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp   File "/usr/lib/python2.7/site-packages/osprofiler/profiler.py", line 154, in wrapper
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp     return f(*args, **kwargs)
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp   File "/usr/lib/python2.7/site-packages/neutron/plugins/ml2/drivers/openvswitch/agent/ovs_neutron_agent.py", line 977, in setup_integration_br
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp     self.int_br.create()
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp   File "/usr/lib/python2.7/site-packages/neutron/agent/common/ovs_lib.py", line 220, in create
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp     FAILMODE_SECURE))
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp   File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/api.py", line 76, in __exit__
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp     self.result = self.commit()
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp   File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 73, in commit
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp     'timeout': self.timeout})
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp TimeoutException: Commands [AddBridgeCommand(datapath_type=system, may_exist=True, name=br-int)] exceeded timeout 10 seconds
2016-12-11 14:16:01.881 8272 ERROR neutron.plugins.ml2.drivers.openvswitch.agent.openflow.native.ovs_ryuapp 
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl [-] Post-commit checks failed
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl Traceback (most recent call last):
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl   File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 152, in post_commit
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl     self.do_post_commit(txn)
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl   File "/usr/lib/python2.7/site-packages/neutron/agent/ovsdb/impl_idl.py", line 174, in do_post_commit
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl     'timeout': self.timeout})
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl TimeoutException: Commands [AddBridgeCommand(datapath_type=system, may_exist=True, name=br-int)] exceeded timeout 10 seconds post-commit
2016-12-11 14:16:01.885 8272 ERROR neutron.agent.ovsdb.impl_idl 
2016-12-11 14:16:01.886 8272 ERROR ryu.lib.hub [-] hub: uncaught exception: Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/ryu/lib/hub.py", line 54, in _launch
    return func(*args, **kwargs)
  File "/usr/lib/python2.7/site-packages/ryu/base/app_manager.py", line 545, in close
    self.uninstantiate(app_name)
  File "/usr/lib/python2.7/site-packages/ryu/base/app_manager.py", line 528, in uninstantiate
    app = self.applications.pop(name)
KeyError: 'ofctl_service'

2016-12-11 14:16:01.977 8272 INFO oslo_rootwrap.client [-] Stopping
rootwrap daemon process with pid=8418

** Affects: neutron
     Importance: High
     Assignee: David Hill (david-hill-ubisoft)
         Status: Triaged

-- 
Failure to launch neutron-openvswitch-agent after tripleo deployment
https://bugs.launchpad.net/bugs/1649124
You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron.