yahoo-eng-team team mailing list archive

[OpenStack Infra <1353953@xxxxxxxxxxxxxxxxxx>]

Reviewed:  https://review.openstack.org/126903
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=6e79981b7caadbbbb2119461034dfe7b4d1c1a64
Submitter: Jenkins
Branch:    proposed/juno

commit 6e79981b7caadbbbb2119461034dfe7b4d1c1a64
Author: Derek Higgins <derekh@xxxxxxxxxx>
Date:   Fri Sep 12 16:31:44 2014 +0100

    Retry getting the list of service plugins
    
    On systems that start both neutron-server and neutron-l3-agent together,
    there is a chance that the first call to neutron will timeout. Retry upto
    4 more times to avoid the l3 agent exiting on startup.
    
    This should make the l3 agent a little more robust on startup but still
    not ideal, ideally it wouldn't exit and retry periodically.
    
    Change-Id: I2171a164f3f77bccd89895d73c1c8d67f7190488
    Closes-Bug: #1353953
    Closes-Bug: #1368152
    Closes-Bug: #1368795
    (cherry picked from commit e7f0b56d74fbfbb08a3b7a0d2da4cefb6fe2aa67)


** Changed in: neutron
       Status: Fix Committed => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1353953

Title:
  Race between neutron-server and l3-agent

Status in OpenStack Neutron (virtual network service):
  Fix Released
Status in tripleo - openstack on openstack:
  In Progress

Bug description:
  http://logs.openstack.org/58/87758/24/check-tripleo/check-tripleo-
  novabm-overcloud-f20-nonha/848e217/console.html

  2014-08-07 10:35:52.753 | + wait_for 30 10 ping -c 1 192.0.2.46
  2014-08-07 10:42:23.169 | Timing out after 300 seconds:
  2014-08-07 10:42:23.169 | COMMAND=ping -c 1 192.0.2.46
  2014-08-07 10:42:23.169 | OUTPUT=PING 192.0.2.46 (192.0.2.46) 56(84) bytes of data.
  2014-08-07 10:42:23.169 | From 192.0.2.46 icmp_seq=1 Destination Host Unreachable
  2014-08-07 10:42:23.169 | 
  2014-08-07 10:42:23.169 | --- 192.0.2.46 ping statistics 

  looks like neutron dhcp agent issues

  http://logs.openstack.org/58/87758/24/check-tripleo/check-tripleo-
  novabm-overcloud-f20-nonha/848e217/logs/overcloud-controller0_logs
  /neutron-dhcp-agent.txt.gz

  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv sudo[14027]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ip netns exec qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6 ip link set tap7e59533d-32 up
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: 2014-08-07 10:31:10.476 12316 ERROR neutron.agent.linux.utils [req-fdebecfd-81d2-48c2-8765-7545e1e9dbb1 None]
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6', 'ip', 'link', 'set', 'tap7e59533d-32', 'up']
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Exit code: 1
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Stdout: ''
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Stderr: 'Cannot open network namespace "qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6": No such file or directory\n'
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv sudo[14032]: neutron : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/usr/bin/neutron-rootwrap /etc/neutron/rootwrap.conf ip netns exec qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6 ip -o link show tap7e59533d-32
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: 2014-08-07 10:31:10.596 12316 ERROR neutron.agent.linux.utils [req-fdebecfd-81d2-48c2-8765-7545e1e9dbb1 None]
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Command: ['sudo', '/usr/bin/neutron-rootwrap', '/etc/neutron/rootwrap.conf', 'ip', 'netns', 'exec', 'qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6', 'ip', '-o', 'link', 'show', 'tap7e59533d-32']
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Exit code: 1
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Stdout: ''
  Aug 07 10:31:10 overcloud-controller0-s42ewsqhiswv neutron-dhcp-agent[12316]: Stderr: 'Cannot open network namespace "qdhcp-09fcf8a1-ffd3-4f99-869a-8b227de009f6": No such file or directory\n'

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1353953/+subscriptions