← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1902678] [NEW] [Fullstack] Wrong output of the cmdline causes tests timeouts

 

Public bug reported:

For example in job https://5d606ad52f952ad04ada-9bb15fccd6d6016f8ed327d788485601.ssl.cf5.rackcdn.com/759555/1/check/neutron-fullstack-with-uwsgi/22fa5fc/job-output.txt most tests were failed due to timeout waiting for the dhcp_agent to be running.
Problem is that agent was running but cmdline output was different then expected.
In the broken test it was:

2020-11-02 12:36:22.643 61765 DEBUG neutron.agent.linux.utils [-] Found
cmdline ['neutron-dhcp-agent', '(python',
'/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/fullstack/agents/dhcp_agent.py',
'--log-dir', '/opt/stack/logs/dsvm-fullstack-
logs/TestLegacyL3Agent.test_north_south_traffic', '--log-file',
'neutron-dhcp-agent--2020-11-02--12-35-55-239343.log', '--config-file',
'/tmp/tmpi4gwk4d5/tmpbrimapun/neutron.conf', '--config-file',
'/tmp/tmpi4gwk4d5/tmpbrimapun/dhcp_agent.ini)'] for process with PID
97892. get_cmdline_from_pid
/home/zuul/src/opendev.org/openstack/neutron/neutron/agent/linux/utils.py:345

And in passing test it is something like:

2020-10-31 01:33:08.095 61708 DEBUG neutron.agent.linux.utils [-] Found
cmdline ['python',
'/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/fullstack/agents/dhcp_agent.py',
'--log-dir', '/opt/stack/logs/dsvm-fullstack-
logs/TestLegacyL3Agent.test_north_south_traffic', '--log-file',
'neutron-dhcp-agent--2020-10-31--01-33-07-081219.log', '--config-file',
'/tmp/tmpxm4m9paq/tmppk8ro3le/neutron.conf', '--config-file',
'/tmp/tmpxm4m9paq/tmppk8ro3le/dhcp_agent.ini'] for process with PID
134342. get_cmdline_from_pid
/home/zuul/src/opendev.org/openstack/neutron/neutron/agent/linux/utils.py:345

** Affects: neutron
     Importance: Undecided
         Status: Confirmed


** Tags: fullstack gate-failure

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1902678

Title:
  [Fullstack] Wrong output of the cmdline causes tests timeouts

Status in neutron:
  Confirmed

Bug description:
  For example in job https://5d606ad52f952ad04ada-9bb15fccd6d6016f8ed327d788485601.ssl.cf5.rackcdn.com/759555/1/check/neutron-fullstack-with-uwsgi/22fa5fc/job-output.txt most tests were failed due to timeout waiting for the dhcp_agent to be running.
  Problem is that agent was running but cmdline output was different then expected.
  In the broken test it was:

  2020-11-02 12:36:22.643 61765 DEBUG neutron.agent.linux.utils [-]
  Found cmdline ['neutron-dhcp-agent', '(python',
  '/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/fullstack/agents/dhcp_agent.py',
  '--log-dir', '/opt/stack/logs/dsvm-fullstack-
  logs/TestLegacyL3Agent.test_north_south_traffic', '--log-file',
  'neutron-dhcp-agent--2020-11-02--12-35-55-239343.log', '--config-
  file', '/tmp/tmpi4gwk4d5/tmpbrimapun/neutron.conf', '--config-file',
  '/tmp/tmpi4gwk4d5/tmpbrimapun/dhcp_agent.ini)'] for process with PID
  97892. get_cmdline_from_pid
  /home/zuul/src/opendev.org/openstack/neutron/neutron/agent/linux/utils.py:345

  And in passing test it is something like:

  2020-10-31 01:33:08.095 61708 DEBUG neutron.agent.linux.utils [-]
  Found cmdline ['python',
  '/home/zuul/src/opendev.org/openstack/neutron/neutron/tests/fullstack/agents/dhcp_agent.py',
  '--log-dir', '/opt/stack/logs/dsvm-fullstack-
  logs/TestLegacyL3Agent.test_north_south_traffic', '--log-file',
  'neutron-dhcp-agent--2020-10-31--01-33-07-081219.log', '--config-
  file', '/tmp/tmpxm4m9paq/tmppk8ro3le/neutron.conf', '--config-file',
  '/tmp/tmpxm4m9paq/tmppk8ro3le/dhcp_agent.ini'] for process with PID
  134342. get_cmdline_from_pid
  /home/zuul/src/opendev.org/openstack/neutron/neutron/agent/linux/utils.py:345

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1902678/+subscriptions


Follow ups