yahoo-eng-team team mailing list archive

[Sergey Yezhkov <yezhkov@xxxxxxxxx>]

Public bug reported:

I have problem with randomly loosing connectivity to instances by FloatingIP.
Instances fully functional and can ping each other by private IP.
This problem state of network appear and disappear randomly but often state changed after create/delete instance in this private network or reboot neutron-openvswitch-agent on the host where instances "live".
Usually, I have loosing connectivity to all instances in same private network and placed on same host. Instances on same host but in different network or in same network but on other host works properly.
Live migration of instance from one host to another usually restore connection to instance.

No errors in neutron/nova/ovs logs.

In problem state of network
tcpdump icmp packets on instance/tap port shows that requests reach instance and instance answer on it.
tcpdump on router/qr port shows only requests but no answers.

In working state of network I see request and answers on router/qr port.

I try to dump OVS flows in problem and working network state, but i did
not found any differences in flows.

ovs-appctl ofproto/trace for icmp answers looks the same for
working/problem state and shows correct output router port

Environment:
I use HA, DVR routers with OVS
OpenStack Train Release installed by kolla
Ubintu Xenial
Neutron 15.0.2 (but problem start appear after upgrade form Rocky to Train release to 15.0.0 neutron version, then to 15.0.1 and now 15.0.2)
OVS version 2.12.0
Changing firewall driver from OVS Hybrid to OVS Native do not help 

Please help me localize and troubleshoot this bug!

** Affects: neutron
     Importance: Undecided
         Status: New


** Tags: dvr ovs

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1864963

Title:
  loosing connectivity to instance with FloatingIP randomly

Status in neutron:
  New

Bug description:
  I have problem with randomly loosing connectivity to instances by FloatingIP.
  Instances fully functional and can ping each other by private IP.
  This problem state of network appear and disappear randomly but often state changed after create/delete instance in this private network or reboot neutron-openvswitch-agent on the host where instances "live".
  Usually, I have loosing connectivity to all instances in same private network and placed on same host. Instances on same host but in different network or in same network but on other host works properly.
  Live migration of instance from one host to another usually restore connection to instance.

  No errors in neutron/nova/ovs logs.

  In problem state of network
  tcpdump icmp packets on instance/tap port shows that requests reach instance and instance answer on it.
  tcpdump on router/qr port shows only requests but no answers.

  In working state of network I see request and answers on router/qr
  port.

  I try to dump OVS flows in problem and working network state, but i
  did not found any differences in flows.

  ovs-appctl ofproto/trace for icmp answers looks the same for
  working/problem state and shows correct output router port

  Environment:
  I use HA, DVR routers with OVS
  OpenStack Train Release installed by kolla
  Ubintu Xenial
  Neutron 15.0.2 (but problem start appear after upgrade form Rocky to Train release to 15.0.0 neutron version, then to 15.0.1 and now 15.0.2)
  OVS version 2.12.0
  Changing firewall driver from OVS Hybrid to OVS Native do not help 

  Please help me localize and troubleshoot this bug!

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1864963/+subscriptions