yahoo-eng-team team mailing list archive

[yatin <2094970@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

With latest eventlet bump to 0.38.2 with
https://review.opendev.org/c/openstack/requirements/+/933257 rally ovn
job timing out[1] and blocking neutron gate.

>From logs seeing couple of errors like:-
RuntimeError: Second simultaneous write on fileno 9 detected.  Unless you really know what you're doing, make sure that only one greenthread can write any particular socket.  Consider using a pools.Pool. If you do know what you're doing and want to disable this error, call eventlet.debug.hub_prevent_multiple_readers(False) - MY THREAD=<built-in method switch of GreenThread object at 0x76e6b4b9f4c0>; THAT THREAD=FdListener('write', 9, <built-in method switch of GreenThread object at 0x76e6af781e80>, <built-in method throw of GreenThread object at 0x76e6af781e80>)
and
ovsdbapp.exceptions.TimeoutException: Commands [DeleteLRouterExtGwCommand(_result=None, lrouter=neutron-99811269-9e53-4e73-85c2-4f5f8113cf70, if_exists=True, maintain_bfd=True), LrDelCommand(_result=None, router=neutron-99811269-9e53-4e73-85c2-4f5f8113cf70, if_exists=True)] exceeded timeout 180 seconds, cause: TXN queue is full

[1] https://zuul.opendev.org/t/openstack/builds?job_name=neutron-ovn-
rally-task&project=openstack%2Fneutron&result=TIMED_OUT&skip=0

** Affects: neutron
     Importance: Critical
         Status: Confirmed


** Tags: ovn

** Changed in: neutron
       Status: New => Confirmed

** Changed in: neutron
   Importance: Undecided => Critical

** Tags added: ovn

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2094970

Title:
  rally ovn job timing out with eventlet 0.38.2

Status in neutron:
  Confirmed

Bug description:
  With latest eventlet bump to 0.38.2 with
  https://review.opendev.org/c/openstack/requirements/+/933257 rally ovn
  job timing out[1] and blocking neutron gate.

  From logs seeing couple of errors like:-
  RuntimeError: Second simultaneous write on fileno 9 detected.  Unless you really know what you're doing, make sure that only one greenthread can write any particular socket.  Consider using a pools.Pool. If you do know what you're doing and want to disable this error, call eventlet.debug.hub_prevent_multiple_readers(False) - MY THREAD=<built-in method switch of GreenThread object at 0x76e6b4b9f4c0>; THAT THREAD=FdListener('write', 9, <built-in method switch of GreenThread object at 0x76e6af781e80>, <built-in method throw of GreenThread object at 0x76e6af781e80>)
  and
  ovsdbapp.exceptions.TimeoutException: Commands [DeleteLRouterExtGwCommand(_result=None, lrouter=neutron-99811269-9e53-4e73-85c2-4f5f8113cf70, if_exists=True, maintain_bfd=True), LrDelCommand(_result=None, router=neutron-99811269-9e53-4e73-85c2-4f5f8113cf70, if_exists=True)] exceeded timeout 180 seconds, cause: TXN queue is full

  [1] https://zuul.opendev.org/t/openstack/builds?job_name=neutron-ovn-
  rally-task&project=openstack%2Fneutron&result=TIMED_OUT&skip=0

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2094970/+subscriptions