yahoo-eng-team team mailing list archive

[yatin <1976323@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

Currently these periodic jobs are running on CentOS 8-Stream(with python
3.6) and failing[1][2]. These are failing as master no longer supports
py3.6. To unblock switching these jobs to run functional/fullstack tests
with python3.8[3] and disabling dbcounter installation.

Ideally these jobs can be switched to CentOS 9-Stream(have python3.9 as default). But found in testing[4] it has couple of issues:-
1. DNS issues are hit randomly during setup until unbound service is setupped after reboot. Can fix by waiting for unbound to be ready or workaround by not using unbound.
2. 4 functional tests are failing:-
- test_delete_multiple_entries --> conntrack delete not deleting enteries (WARNING neutron.privileged.agent.linux.netlink_lib [-] Netlink query failed looks related)
- test_delete_icmp_entry --> conntrack delete not deleting enteries (WARNING neutron.privileged.agent.linux.netlink_lib [-] Netlink query failed looks related)
- test_rule_application_converges(IptablesFirewallDriver,with ipset)
   --> self.assertEqual([], self.firewall.iptables._apply()) fails as _apply not returning empty list as expected  --> might be due to iptables behavior in C9-Stream
- test_rule_application_converges(IptablesFirewallDriver,without ipset)
   --> self.assertEqual([], self.firewall.iptables._apply()) fails as _apply not returning empty list as expected --> might be due to iptables behavior in C9-Stream

3. 2 fullstack tests are failing:-
- neutron.tests.fullstack.test_l3_agent.TestLegacyL3Agent.test_north_south_traffic
- neutron.tests.fullstack.test_local_ip.LocalIPTestCase.test_vm_is_accessible_by_local_ip(static_nat)
Both failing at ping
neutron.tests.common.machine_fixtures.FakeMachineException: No ICMP reply obtained from IP address 2001:db8:1234::
neutron.tests.common.machine_fixtures.FakeMachineException: No ICMP reply obtained from IP address 10.0.0.10


[1] https://zuul.openstack.org/builds?job_name=neutron-functional-with-uwsgi-fips&project=openstack%2Fneutron&branch=master&pipeline=periodic&skip=0
[2] https://zuul.openstack.org/builds?job_name=neutron-functional-with-uwsgi-fips&project=openstack%2Fneutron&branch=master&pipeline=periodic&skip=0
[3] https://review.opendev.org/c/openstack/neutron/+/843252
[4] https://review.opendev.org/c/openstack/neutron/+/843245

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1976323

Title:
  [functional/fullstack][master] move fips periodic job to CentOS
  9-Stream

Status in neutron:
  New

Bug description:
  Currently these periodic jobs are running on CentOS 8-Stream(with
  python 3.6) and failing[1][2]. These are failing as master no longer
  supports py3.6. To unblock switching these jobs to run
  functional/fullstack tests with python3.8[3] and disabling dbcounter
  installation.

  Ideally these jobs can be switched to CentOS 9-Stream(have python3.9 as default). But found in testing[4] it has couple of issues:-
  1. DNS issues are hit randomly during setup until unbound service is setupped after reboot. Can fix by waiting for unbound to be ready or workaround by not using unbound.
  2. 4 functional tests are failing:-
  - test_delete_multiple_entries --> conntrack delete not deleting enteries (WARNING neutron.privileged.agent.linux.netlink_lib [-] Netlink query failed looks related)
  - test_delete_icmp_entry --> conntrack delete not deleting enteries (WARNING neutron.privileged.agent.linux.netlink_lib [-] Netlink query failed looks related)
  - test_rule_application_converges(IptablesFirewallDriver,with ipset)
     --> self.assertEqual([], self.firewall.iptables._apply()) fails as _apply not returning empty list as expected  --> might be due to iptables behavior in C9-Stream
  - test_rule_application_converges(IptablesFirewallDriver,without ipset)
     --> self.assertEqual([], self.firewall.iptables._apply()) fails as _apply not returning empty list as expected --> might be due to iptables behavior in C9-Stream

  3. 2 fullstack tests are failing:-
  - neutron.tests.fullstack.test_l3_agent.TestLegacyL3Agent.test_north_south_traffic
  - neutron.tests.fullstack.test_local_ip.LocalIPTestCase.test_vm_is_accessible_by_local_ip(static_nat)
  Both failing at ping
  neutron.tests.common.machine_fixtures.FakeMachineException: No ICMP reply obtained from IP address 2001:db8:1234::
  neutron.tests.common.machine_fixtures.FakeMachineException: No ICMP reply obtained from IP address 10.0.0.10

  
  [1] https://zuul.openstack.org/builds?job_name=neutron-functional-with-uwsgi-fips&project=openstack%2Fneutron&branch=master&pipeline=periodic&skip=0
  [2] https://zuul.openstack.org/builds?job_name=neutron-functional-with-uwsgi-fips&project=openstack%2Fneutron&branch=master&pipeline=periodic&skip=0
  [3] https://review.opendev.org/c/openstack/neutron/+/843252
  [4] https://review.opendev.org/c/openstack/neutron/+/843245

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1976323/+subscriptions