yahoo-eng-team team mailing list archive

[OpenStack Infra <1817306@xxxxxxxxxxxxxxxxxx>]

Reviewed:  https://review.openstack.org/638648
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=1ee18775a99492f445f1fb29e2d4639cbdff613d
Submitter: Zuul
Branch:    master

commit 1ee18775a99492f445f1fb29e2d4639cbdff613d
Author: Oleg Bondarev <obondarev@xxxxxxxxxxxx>
Date:   Fri Feb 22 16:00:30 2019 +0400

    DVR edge router: avoid accidental centralized floating IP remove
    
    Need to pass centralized floating IPs as preserve_ips to
    _external_gateway_added during DVR router update.
    Otherwise IP addresses will be deleted from gw device in certain case.
    The case is when a router with active centralized floating IPs is
    being scheduled to a new dvr_snat L3 agent (rescheduled from a down one).
    Please see corresponding traces in the bug description.
    
    Change-Id: Iaeb9fbed73144df6fcd9092c665ed19986e85f4d
    Closes-bug: #1817306


** Changed in: neutron
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1817306

Title:
  Failed gARP for floating IP in l3 agent logs

Status in neutron:
  Fix Released

Bug description:
  release: Pike.

  When a DVR router with centralized floating IPs is rescheduled from down l3 agent to another,
  following traces are seen on the destination agent:

  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib [-] Failed sending gratuitous ARP to 10.13.250.14 on qg-af0de258-a8 in namespace snat-afe70a67-a007-4bcf-93ac-099aad63411c: Exit code: 2; Stdin: ; Stdout: ; Stderr: bind: Cannot assign requested address
  : ProcessExecutionError: Exit code: 2; Stdin: ; Stdout: ; Stderr: bind: Cannot assign requested address
  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib Traceback (most recent call last):
  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/ip_lib.py", line 1097, in _arping
  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib     ip_wrapper.netns.execute(arping_cmd, extra_ok_codes=[1])
  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/ip_lib.py", line 916, in execute
  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib     log_fail_as_error=log_fail_as_error, **kwargs)
  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib   File "/usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py", line 151, in execute
  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib     raise ProcessExecutionError(msg, returncode=returncode)
  2019-02-21 14:55:59,150.150 24730 ERROR neutron.agent.linux.ip_lib ProcessExecutionError: Exit code: 2; Stdin: ; Stdout: ; Stderr: bind: Cannot assign requested address

  Earlier in logs following is seen:

  2019-02-22 07:52:14,894.894 9528 DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ip', 'netns', 'exec', 'snat-afe70a67-a007-4bcf-93ac-099aad63411c', 'ip', '-4', 'addr', 'del', '10.13.250.14/32', 'dev', 'qg-af0de258-a8'] execute_rootwrap_daemon /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:108
  2019-02-22 07:52:14,922.922 9528 DEBUG neutron.agent.linux.utils [-] Running command (rootwrap daemon): ['ip', 'netns', 'exec', 'snat-afe70a67-a007-4bcf-93ac-099aad63411c', 'conntrack', '-D', '-d', '10.13.250.14'] execute_rootwrap_daemon /usr/lib/python2.7/dist-packages/neutron/agent/linux/utils.py:108

  So centralized floating ip is deleted from gw device for some reason.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1817306/+subscriptions