yahoo-eng-team team mailing list archive

[Slawek Kaplonski <1906654@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

I'm not really sure why but after we switched neutron-tempest-plugin-api
job to be run under uwsgi, test
neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active
started to failing pretty often like e.g.:

https://12ef4cf37bb4f9cf8615-49968699300828e6c9b78fd54dff75ef.ssl.cf5.rackcdn.com/763218/3/check
/neutron-tempest-plugin-api/3688867/testr_results.html

Traceback (most recent call last):
  File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py", line 80, in wait_until_true
    eventlet.sleep(sleep)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/eventlet/greenthread.py", line 36, in sleep
    hub.switch()
  File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/eventlet/hubs/hub.py", line 313, in switch
    return self.greenlet.switch()
eventlet.timeout.Timeout: 60 seconds

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/api/admin/test_dhcp_agent_scheduler.py", line 46, in test_dhcp_port_status_active
    utils.wait_until_true(dhcp_port_active)
  File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py", line 85, in wait_until_true
    raise WaitTimeout("Timed out after %d seconds" % timeout)
neutron_tempest_plugin.common.utils.WaitTimeout: Timed out after 60 seconds


>From what I found in the logs it seems that it's failing because neutron-ovs-agent is busy in the time of that test and rpc_loop iteration takes more than 60 seconds. Due to that port isn't switched to be UP and test fails.
I hope that maybe https://review.opendev.org/c/openstack/neutron/+/755313 will fix that issue but we will see.

** Affects: neutron
     Importance: Critical
         Status: Confirmed


** Tags: gate-failure ovs

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1906654

Title:
  neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active
  is failing often

Status in neutron:
  Confirmed

Bug description:
  I'm not really sure why but after we switched neutron-tempest-plugin-
  api job to be run under uwsgi, test
  neutron_tempest_plugin.api.admin.test_dhcp_agent_scheduler.DHCPAgentSchedulersTestJSON.test_dhcp_port_status_active
  started to failing pretty often like e.g.:

  https://12ef4cf37bb4f9cf8615-49968699300828e6c9b78fd54dff75ef.ssl.cf5.rackcdn.com/763218/3/check
  /neutron-tempest-plugin-api/3688867/testr_results.html

  Traceback (most recent call last):
    File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py", line 80, in wait_until_true
      eventlet.sleep(sleep)
    File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/eventlet/greenthread.py", line 36, in sleep
      hub.switch()
    File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/eventlet/hubs/hub.py", line 313, in switch
      return self.greenlet.switch()
  eventlet.timeout.Timeout: 60 seconds

  During handling of the above exception, another exception occurred:

  Traceback (most recent call last):
    File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/api/admin/test_dhcp_agent_scheduler.py", line 46, in test_dhcp_port_status_active
      utils.wait_until_true(dhcp_port_active)
    File "/opt/stack/tempest/.tox/tempest/lib/python3.8/site-packages/neutron_tempest_plugin/common/utils.py", line 85, in wait_until_true
      raise WaitTimeout("Timed out after %d seconds" % timeout)
  neutron_tempest_plugin.common.utils.WaitTimeout: Timed out after 60 seconds

  
  From what I found in the logs it seems that it's failing because neutron-ovs-agent is busy in the time of that test and rpc_loop iteration takes more than 60 seconds. Due to that port isn't switched to be UP and test fails.
  I hope that maybe https://review.opendev.org/c/openstack/neutron/+/755313 will fix that issue but we will see.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1906654/+subscriptions