yahoo-eng-team team mailing list archive

[Slawek Kaplonski <1850626@xxxxxxxxxxxxxxxxxx>]

Public bug reported:

Neutron-dynamic-routing scenario jobs in neutron-tempest-plugin repo are
failing all the time since few days.

Example of failure
https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_cee/691855/1/check
/neutron-tempest-plugin-dynamic-routing/cee3785/testr_results.html.gz

It seems that this happens due to error in service plugin, see neutron
server log:

Notify callbacks ['neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854649727'] for bgp_speaker, after_create {{(pid=19640) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}}
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager [None req-c747f1f4-6424-4812-b7e4-cfc5c083fd81 tempest-BgpSpeakerTestJSON-1886159994 tempest-BgpSpeakerTestJSON-1886159994] Error during notification for neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854649727 bgp_speaker, after_create: TypeError: bind() takes 4 positional arguments but 5 were given
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last):
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager   File "/usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py", line 197, in _notify_loop
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager     callback(resource, event, trigger, **kwargs)
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager   File "/opt/stack/neutron-dynamic-routing/neutron_dynamic_routing/services/bgp/scheduler/bgp_dragent_scheduler.py", line 202, in schedule_bgp_speaker_callback
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager     plugin.schedule_bgp_speaker(ctx, payload['bgp_speaker'])
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager   File "/opt/stack/neutron-dynamic-routing/neutron_dynamic_routing/db/bgp_dragentscheduler_db.py", line 100, in schedule_bgp_speaker
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager     created_bgp_speaker)
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager   File "/opt/stack/neutron/neutron/scheduler/base_scheduler.py", line 55, in schedule
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager     context, chosen_agents, resource['id'], force_scheduling)
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager TypeError: bind() takes 4 positional arguments but 5 were given
Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager 

It is caused by https://review.opendev.org/#/c/288271/ which we merged
recently and revert of this patch is already proposed in
https://review.opendev.org/#/c/691710/

** Affects: neutron
     Importance: Critical
     Assignee: Slawek Kaplonski (slaweq)
         Status: Confirmed


** Tags: gate-failure l3-bgp

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1850626

Title:
  neutron-dynamic-routing: TypeError: bind() takes 4 positional
  arguments but 5 were given

Status in neutron:
  Confirmed

Bug description:
  Neutron-dynamic-routing scenario jobs in neutron-tempest-plugin repo
  are failing all the time since few days.

  Example of failure
  https://openstack.fortnebula.com:13808/v1/AUTH_e8fd161dc34c421a979a9e6421f823e9/zuul_opendev_logs_cee/691855/1/check
  /neutron-tempest-plugin-dynamic-routing/cee3785/testr_results.html.gz

  It seems that this happens due to error in service plugin, see neutron
  server log:

  Notify callbacks ['neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854649727'] for bgp_speaker, after_create {{(pid=19640) _notify_loop /usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py:193}}
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager [None req-c747f1f4-6424-4812-b7e4-cfc5c083fd81 tempest-BgpSpeakerTestJSON-1886159994 tempest-BgpSpeakerTestJSON-1886159994] Error during notification for neutron_dynamic_routing.services.bgp.scheduler.bgp_dragent_scheduler.BgpDrAgentSchedulerBase.schedule_bgp_speaker_callback--9223372036854649727 bgp_speaker, after_create: TypeError: bind() takes 4 positional arguments but 5 were given
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager Traceback (most recent call last):
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager   File "/usr/local/lib/python3.6/dist-packages/neutron_lib/callbacks/manager.py", line 197, in _notify_loop
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager     callback(resource, event, trigger, **kwargs)
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager   File "/opt/stack/neutron-dynamic-routing/neutron_dynamic_routing/services/bgp/scheduler/bgp_dragent_scheduler.py", line 202, in schedule_bgp_speaker_callback
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager     plugin.schedule_bgp_speaker(ctx, payload['bgp_speaker'])
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager   File "/opt/stack/neutron-dynamic-routing/neutron_dynamic_routing/db/bgp_dragentscheduler_db.py", line 100, in schedule_bgp_speaker
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager     created_bgp_speaker)
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager   File "/opt/stack/neutron/neutron/scheduler/base_scheduler.py", line 55, in schedule
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager     context, chosen_agents, resource['id'], force_scheduling)
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager TypeError: bind() takes 4 positional arguments but 5 were given
  Oct 29 19:11:05.959429 ubuntu-bionic-ovh-bhs1-0012563860 neutron-server[19534]: ERROR neutron_lib.callbacks.manager 

  It is caused by https://review.opendev.org/#/c/288271/ which we merged
  recently and revert of this patch is already proposed in
  https://review.opendev.org/#/c/691710/

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1850626/+subscriptions