← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1446583] Re: services no long reliably stop in stable/kilo

 

The left over processes in the failing run are as follows:

2015-04-21 03:15:40.613 | stack    26996  0.1  0.9 149236 73800 ?        Ss   03:01   0:01 /usr/bin/python /usr/local/bin/keystone-all --config-file /etc/keystone/keystone.conf
2015-04-21 03:15:40.613 | stack    27055  0.4  1.0 261868 83552 ?        S    03:01   0:03 /usr/bin/python /usr/local/bin/keystone-all --config-file /etc/keystone/keystone.conf
2015-04-21 03:15:40.613 | stack    27060  0.5  1.0 261828 83584 ?        S    03:01   0:04 /usr/bin/python /usr/local/bin/keystone-all --config-file /etc/keystone/keystone.conf


26996 is the session leader, and who got the original kill signal. It looks like 27055 and 27060 never got the signal, or never logged it.

** Also affects: keystone
   Importance: Undecided
       Status: New

** Changed in: keystone
   Importance: Undecided => Critical

** Changed in: keystone
    Milestone: None => kilo-rc2

** Also affects: cinder
   Importance: Undecided
       Status: New

** Changed in: cinder
   Importance: Undecided => Critical

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Keystone.
https://bugs.launchpad.net/bugs/1446583

Title:
  services no long reliably stop in stable/kilo

Status in Cinder:
  New
Status in OpenStack Identity (Keystone):
  New
Status in The Oslo library incubator:
  New

Bug description:
  In attempting to upgrade the upgrade branch structure to support
  stable/kilo -> master in devstack gate, we found the project could no
  longer pass Grenade testing. The reason is because pkill -g is no
  longer reliably killing off the services:

  http://logs.openstack.org/91/175391/5/gate/gate-grenade-
  dsvm/0ad4a94/logs/grenade.sh.txt.gz#_2015-04-21_03_15_31_436

  It has been seen with keystone-all and cinder-api on this patch
  series:

  http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiVGhlIGZvbGxvd2luZyBzZXJ2aWNlcyBhcmUgc3RpbGwgcnVubmluZ1wiIEFORCBtZXNzYWdlOlwiZGllXCIiLCJmaWVsZHMiOltdLCJvZmZzZXQiOjAsInRpbWVmcmFtZSI6IjE3MjgwMCIsImdyYXBobW9kZSI6ImNvdW50IiwidGltZSI6eyJ1c2VyX2ludGVydmFsIjowfSwic3RhbXAiOjE0Mjk2MTU0NTQ2MzB9

  There were a number of changes to the oslo-incubator service.py code
  during kilo, it's unclear at this point which is the issue.

To manage notifications about this bug go to:
https://bugs.launchpad.net/cinder/+bug/1446583/+subscriptions