yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1407410] Re: It takes too much time for L3 agent to make router active ( about 2 minutes ).

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Chuck Short <chuck.short@xxxxxxxxxxxxx>
Date: Thu, 29 Jan 2015 15:49:51 -0000
Reply-to: Bug 1407410 <1407410@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
** Also affects: neutron/juno
   Importance: Undecided
       Status: New

** Changed in: neutron/juno
    Milestone: None => 2014.2.2

** Changed in: neutron/juno
       Status: New => Fix Committed

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1407410

Title:
  It takes too much time for L3 agent to make router active ( about 2
  minutes ).

Status in OpenStack Neutron (virtual network service):
  Fix Committed
Status in neutron juno series:
  Fix Committed

Bug description:
  It takes too much time  for L3 agent to make router active ( about 2 minutes ).
  This is especially not good for HA setups. 

  openstack-neutron-2014.2.1-5.el7ost.noarch
       
  Reproduced on non HA :
       
  1.openstack-service stop neutron-openvswitch-agent | openstack-service stop neutron-l3-agent |  openstack-service stop neutron-dhcp-agent
       
  2.neutron-netns-cleanup --config-file=/etc/neutron/neutron.conf --config-file=/etc/neutron/dhcp_agent.ini  --config-file=/etc/neutron/l3_agent.ini  --force > /var/log/neutron/l3-agent.log
       
  3.openstack-service start neutron-openvswitch-agent | openstack-service start neutron-l3-agent |  openstack-service start neutron-dhcp-agent
       
  4.wait until namespace is created.
  --------------------------------------------------------------------------------     
  [root@networker ~]# cat  /var/log/neutron/l3-agent.log
  2015-01-01 07:53:49.091 4412 INFO neutron.common.config [-] Logging enabled!    2015-01-01 07:53:49.095 4412 DEBUG neutron.common.utils [-] Reloading cached file /etc/neutron/policy.json read_cached_file /usr/lib/python2.7/site-packages/neutron/common/utils.py:118
      2015-01-01 07:53:49.095 4412 DEBUG neutron.policy [-] Loading policies from file: /etc/neutron/policy.json _set_rules /usr/lib/python2.7/site-packages/neutron/policy.py:91
      2015-01-01 07:53:49.102 4412 DEBUG neutron.common.rpc [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] neutron.agent.l3_agent.L3PluginApi method call called with arguments (<neutron.context.ContextBase object at 0x2d9b4d0>, {'args': {}, 'namespace': None, 'method': 'get_service_plugin_list'}) {'topic': 'q-l3-plugin', 'version': '1.3'} wrapper /usr/lib/python2.7/site-packages/neutron/common/log.py:33
      2015-01-01 07:53:49.104 4412 INFO oslo.messaging._drivers.impl_rabbit [req-f925a4bf-9862-4e46-81eb-6695016b0c21 ] Connecting to AMQP server on 10.35.187.88:5672
      2015-01-01 07:53:49.131 4412 INFO oslo.messaging._drivers.impl_rabbit [req-f925a4bf-9862-4e46-81eb-6695016b0c21 ] Connected to AMQP server on 10.35.187.88:5672
      2015-01-01 07:53:49.139 4412 INFO oslo.messaging._drivers.impl_rabbit [req-f925a4bf-9862-4e46-81eb-6695016b0c21 ] Connecting to AMQP server on 10.35.187.88:5672
      2015-01-01 07:53:49.161 4412 INFO oslo.messaging._drivers.impl_rabbit [req-f925a4bf-9862-4e46-81eb-6695016b0c21 ] Connected to AMQP server on 10.35.187.88:5672
      2015-01-01 07:53:49.198 4412 DEBUG neutron.services.firewall.agents.l3reference.firewall_l3_agent [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] Initializing firewall agent __init__ /usr/lib/python2.7/site-packages/neutron/services/firewall/agents/l3reference/firewall_l3_agent.py:58
      2015-01-01 07:53:49.200 4412 DEBUG neutron.services.firewall.drivers.linux.iptables_fwaas [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] Initializing fwaas iptables driver __init__ /usr/lib/python2.7/site-packages/neutron/services/firewall/drivers/linux/iptables_fwaas.py:49
      2015-01-01 07:53:49.200 4412 DEBUG neutron.services.firewall.agents.l3reference.firewall_l3_agent [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] FWaaS Driver Loaded: 'neutron.services.firewall.drivers.linux.iptables_fwaas.IptablesFwaasDriver' __init__ /usr/lib/python2.7/site-packages/neutron/services/firewall/agents/l3reference/firewall_l3_agent.py:80
      2015-01-01 07:53:49.206 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] Full set of CONF: _wait_for_exit_or_signal /usr/lib/python2.7/site-packages/neutron/openstack/common/service.py:167
      2015-01-01 07:53:49.206 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] ******************************************************************************** log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1983
      2015-01-01 07:53:49.207 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] Configuration options gathered from: log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1984
      2015-01-01 07:53:49.207 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] command line args: ['--config-file', '/usr/share/neutron/neutron-dist.conf', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/l3_agent.ini', '--config-file', '/etc/neutron/fwaas_driver.ini', '--log-file', '/var/log/neutron/l3-agent.log'] log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1985
      2015-01-01 07:53:49.207 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] config files: ['/usr/share/neutron/neutron-dist.conf', '/etc/neutron/neutron.conf', '/etc/neutron/l3_agent.ini', '/etc/neutron/fwaas_driver.ini'] log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1986
      2015-01-01 07:53:49.208 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] ================================================================================ log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1987
      2015-01-01 07:53:49.208 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] admin_password                 = **** log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.209 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] admin_tenant_name              = None log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.209 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] admin_user                     = None log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.209 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] agent_mode                     = legacy log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.210 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] allow_bulk                     = True log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.210 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] allow_overlapping_ips          = True log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.211 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] allow_pagination               = False log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.211 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] allow_sorting                  = False log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.211 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] amqp_auto_delete               = False log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.212 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] amqp_durable_queues            = False log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.212 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] api_extensions_path            =  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.213 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] api_paste_config               = /usr/share/neutron/api-paste.ini log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.213 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] api_workers                    = 0 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.213 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] auth_region                    = None log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.214 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] auth_strategy                  = keystone log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.214 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] auth_url                       = None log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.214 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] backdoor_port                  = None log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.215 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] backlog                        = 4096 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.215 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] base_mac                       = fa:16:3e:00:00:00 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.216 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] bind_host                      = 0.0.0.0 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.216 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] bind_port                      = 9696 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.216 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] check_child_processes_action   = respawn log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.217 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] check_child_processes_interval = 60 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.217 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] config_dir                     = None log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.218 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] config_file                    = ['/usr/share/neutron/neutron-dist.conf', '/etc/neutron/neutron.conf', '/etc/neutron/l3_agent.ini', '/etc/neutron/fwaas_driver.ini'] log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.218 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] control_exchange               = neutron log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.218 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] core_plugin                    = neutron.plugins.ml2.plugin.Ml2Plugin log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.219 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] debug                          = True log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.219 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN'] log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.220 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] dhcp_agent_notification        = True log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.220 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] dhcp_lease_duration            = 86400 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.221 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] disable_process_locking        = False log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.221 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] enable_metadata_proxy          = True log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.221 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] endpoint_type                  = publicURL log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.222 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] external_network_bridge        =  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.222 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] external_pids                  = /var/lib/neutron/external/pids log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.223 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] fake_rabbit                    = False log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.223 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] fatal_deprecations             = False log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.223 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] force_gateway_on_subnet        = True log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.224 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] gateway_external_network_id    =  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.224 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] ha_confs_path                  = /var/lib/neutron/ha_confs log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.225 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] ha_vrrp_advert_int             = 2 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.225 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] ha_vrrp_auth_password          = **** log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.226 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] ha_vrrp_auth_type              = PASS log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.226 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] handle_internal_only_routers   = True log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.226 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] host                           = networker.novalocal log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.227 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] instance_format                = [instance: %(uuid)s]  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.227 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] instance_uuid_format           = [instance: %(uuid)s]  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.227 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] interface_driver               = neutron.agent.linux.interface.OVSInterfaceDriver log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.228 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] kombu_reconnect_delay          = 1.0 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.228 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] kombu_ssl_ca_certs             =  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.229 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] kombu_ssl_certfile             =  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.229 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] kombu_ssl_keyfile              =  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.229 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] kombu_ssl_version              =  log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.230 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] lock_path                      = /var/lib/neutron/lock log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.230 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] log_config_append              = None log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.231 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] log_date_format                = %Y-%m-%d %H:%M:%S log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.231 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] log_dir                        = /var/log/neutron log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.232 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] log_file                       = /var/log/neutron/l3-agent.log log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.232 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] log_format                     = None log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.232 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] logging_context_format_string  = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [%(request_id)s %(user_identity)s] %(instance)s%(message)s log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.233 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] logging_debug_format_suffix    = %(funcName)s %(pathname)s:%(lineno)d log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.233 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] logging_default_format_string  = %(asctime)s.%(msecs)03d %(process)d %(levelname)s %(name)s [-] %(instance)s%(message)s log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.233 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] logging_exception_prefix       = %(asctime)s.%(msecs)03d %(process)d TRACE %(name)s %(instance)s log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.234 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] mac_generation_retries         = 16 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.234 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] max_dns_nameservers            = 5 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.235 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] max_fixed_ips_per_port         = 5 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.235 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21 None] max_header_line                = 16384 log_opt_values /usr/lib/python2.7/site-packages/oslo/config/cfg.py:1996
      2015-01-01 07:53:49.235 4412 DEBUG neutron.openstack.common.service [req-f925a4bf-9862-4e46-81eb-6695016b0c21

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1407410/+subscriptions
References

[Bug 1407410] [NEW] It takes too much time for L3 agent to make router active ( about 2 minutes ).
From: Leonid Natapov, 2015-01-04