← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 2126790] [NEW] q-dhcp process is not gracefully shutting down

 

Public bug reported:

neutron git SHA: 783ce1cd4d99ca20fb705d6540fbce5865fe07d7
devstack git SHA: a3e37c86cab4ec43a4a6d1c1386abf12bc034db7

On devstack, the devstack@q-dhcp.service process is not gracefully
shutting down, causing a five minute delay in running clean.sh.

>From the systemd system log:

Oct 03 17:29:09 octaviaflam systemd[1]: Stopping devstack@q-dhcp.service - Devstack devstack@q-dhcp.service...
Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: State 'stop-sigterm' timed out. Killing.
Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Killing process 1087363 (neutron-dhcp-ag) with signal SIGKILL.
Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Main process exited, code=killed, status=9/KILL
Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Failed with result 'timeout'.
Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Unit process 1087863 (dnsmasq) remains running after unit stopped.
Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Unit process 1087867 (dnsmasq) remains running after unit stopped.
Oct 03 17:34:09 octaviaflam systemd[1]: Stopped devstack@q-dhcp.service - Devstack devstack@q-dhcp.service.
Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Consumed 4min 24.000s CPU time, 544.9M memory peak, 0B memory swap peak.

Reproduce:
1. Stack a devstack instance
2. Run "clean.sh" for devstack
3. Run "journalctl --system | grep "q-dhcp"

Expected Result:
q-dhcp should gracefully shutdown on receiving a SIGTERM from systemd

Actual Result:
The shutdown process is delayed for five minutes until the SIGTERM timeout expires at which point systemd issues a SIGKILL

** Affects: neutron
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/2126790

Title:
  q-dhcp process is not gracefully shutting down

Status in neutron:
  New

Bug description:
  neutron git SHA: 783ce1cd4d99ca20fb705d6540fbce5865fe07d7
  devstack git SHA: a3e37c86cab4ec43a4a6d1c1386abf12bc034db7

  On devstack, the devstack@q-dhcp.service process is not gracefully
  shutting down, causing a five minute delay in running clean.sh.

  From the systemd system log:

  Oct 03 17:29:09 octaviaflam systemd[1]: Stopping devstack@q-dhcp.service - Devstack devstack@q-dhcp.service...
  Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: State 'stop-sigterm' timed out. Killing.
  Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Killing process 1087363 (neutron-dhcp-ag) with signal SIGKILL.
  Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Main process exited, code=killed, status=9/KILL
  Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Failed with result 'timeout'.
  Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Unit process 1087863 (dnsmasq) remains running after unit stopped.
  Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Unit process 1087867 (dnsmasq) remains running after unit stopped.
  Oct 03 17:34:09 octaviaflam systemd[1]: Stopped devstack@q-dhcp.service - Devstack devstack@q-dhcp.service.
  Oct 03 17:34:09 octaviaflam systemd[1]: devstack@q-dhcp.service: Consumed 4min 24.000s CPU time, 544.9M memory peak, 0B memory swap peak.

  Reproduce:
  1. Stack a devstack instance
  2. Run "clean.sh" for devstack
  3. Run "journalctl --system | grep "q-dhcp"

  Expected Result:
  q-dhcp should gracefully shutdown on receiving a SIGTERM from systemd

  Actual Result:
  The shutdown process is delayed for five minutes until the SIGTERM timeout expires at which point systemd issues a SIGKILL

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/2126790/+subscriptions