yahoo-eng-team team mailing list archive

[Kate Coyne <kate.coyne@xxxxxxxxxxx>]

Public bug reported:

Havana release: I have several instances running and while I can delete most instances there are times where I can not delete one that seems to get stuck in 'deleting' state.  I have tried to reset from the command line to error and delete and also back to active and delete with no success.   I did wait quite a time after each to allow the deletion to occur.    The only way I could delete the instances was to go into the mysql db and get rid of the specific entries/tables for this instance.
(this worked).
I can see in my nova log that it was trying to delete:
2014-05-20 14:55:20.343 19358 DEBUG routes.middleware [-] Matched DELETE /a843cb922df24063b50c3accdc6ded44/servers/dbbc203a-9a18-493a-b3d5-da82e5232f59 __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:100
2014-05-20 14:55:20.344 19358 DEBUG routes.middleware [-] Route path: '/{project_id}/servers/:(id)', defaults: {'action': u'delete', 'controller': <nova.api.openstack.wsgi.Resource object at 0x2b3cc50>} __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:102
2014-05-20 14:55:20.344 19358 DEBUG routes.middleware [-] Match dict: {'action': u'delete', 'controller': <nova.api.openstack.wsgi.Resource object at 0x2b3cc50>, 'project_id': u'a843cb922df24063b50c3accdc6ded44', 'id': u'dbbc203a-9a18-493a-b3d5-da82e5232f59'} __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:103
2014-05-20 14:55:20.344 19358 DEBUG nova.api.openstack.wsgi [req-5e93a3b0-5430-4a1f-a86f-8ece4e13eece 161172840f564803ab4e6b2cde1f13de a843cb922df24063b50c3accdc6ded44] No Content-Type provided in request get_body /usr/lib/python2.6/site-packages/nova/api/openstack/wsgi.py:835
2014-05-20 14:55:20.345 19358 DEBUG nova.api.openstack.wsgi [req-5e93a3b0-5430-4a1f-a86f-8ece4e13eece 161172840f564803ab4e6b2cde1f13de a843cb922df24063b50c3accdc6ded44] Calling method <bound method Controller.delete of <nova.api.openstack.compute.servers.Controller object at 0x29931d0>> _process_stack /usr/lib/python2.6/site-packages/nova/api/openstack/wsgi.py:962

but I see this many times over
2014-05-20 14:55:26.541 19351 DEBUG routes.middleware [-] Matched DELETE /a843cb922df24063b50c3accdc6ded44/servers/dbbc203a-9a18-493a-b3d5-da82e5232f59 __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:100
2014-05-20 14:55:26.542 19351 DEBUG routes.middleware [-] Match dict: {'action': u'delete', 'controller': <nova.api.openstack.wsgi.Resource object at 0x2b3cc50>, 'project_id': u'a843cb922df24063b50c3accdc6ded44', 'id': u'dbbc203a-9a18-493a-b3d5-da82e5232f59'} __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:103

2014-05-20 14:55:26.583 19351 DEBUG nova.compute.api [req-3278602c-d0ef-
455f-af8e-a6e20447322e 161172840f564803ab4e6b2cde1f13de
a843cb922df24063b50c3accdc6ded44] [instance: dbbc203a-9a18-493a-
b3d5-da82e5232f59] Going to try to terminate instance delete
/usr/lib/python2.6/site-packages/nova/compute/api.py:1564

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1323786

Title:
  Can not delete instance Havana

Status in OpenStack Compute (Nova):
  New

Bug description:
  Havana release: I have several instances running and while I can delete most instances there are times where I can not delete one that seems to get stuck in 'deleting' state.  I have tried to reset from the command line to error and delete and also back to active and delete with no success.   I did wait quite a time after each to allow the deletion to occur.    The only way I could delete the instances was to go into the mysql db and get rid of the specific entries/tables for this instance.
  (this worked).
  I can see in my nova log that it was trying to delete:
  2014-05-20 14:55:20.343 19358 DEBUG routes.middleware [-] Matched DELETE /a843cb922df24063b50c3accdc6ded44/servers/dbbc203a-9a18-493a-b3d5-da82e5232f59 __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:100
  2014-05-20 14:55:20.344 19358 DEBUG routes.middleware [-] Route path: '/{project_id}/servers/:(id)', defaults: {'action': u'delete', 'controller': <nova.api.openstack.wsgi.Resource object at 0x2b3cc50>} __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:102
  2014-05-20 14:55:20.344 19358 DEBUG routes.middleware [-] Match dict: {'action': u'delete', 'controller': <nova.api.openstack.wsgi.Resource object at 0x2b3cc50>, 'project_id': u'a843cb922df24063b50c3accdc6ded44', 'id': u'dbbc203a-9a18-493a-b3d5-da82e5232f59'} __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:103
  2014-05-20 14:55:20.344 19358 DEBUG nova.api.openstack.wsgi [req-5e93a3b0-5430-4a1f-a86f-8ece4e13eece 161172840f564803ab4e6b2cde1f13de a843cb922df24063b50c3accdc6ded44] No Content-Type provided in request get_body /usr/lib/python2.6/site-packages/nova/api/openstack/wsgi.py:835
  2014-05-20 14:55:20.345 19358 DEBUG nova.api.openstack.wsgi [req-5e93a3b0-5430-4a1f-a86f-8ece4e13eece 161172840f564803ab4e6b2cde1f13de a843cb922df24063b50c3accdc6ded44] Calling method <bound method Controller.delete of <nova.api.openstack.compute.servers.Controller object at 0x29931d0>> _process_stack /usr/lib/python2.6/site-packages/nova/api/openstack/wsgi.py:962

  but I see this many times over
  2014-05-20 14:55:26.541 19351 DEBUG routes.middleware [-] Matched DELETE /a843cb922df24063b50c3accdc6ded44/servers/dbbc203a-9a18-493a-b3d5-da82e5232f59 __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:100
  2014-05-20 14:55:26.542 19351 DEBUG routes.middleware [-] Match dict: {'action': u'delete', 'controller': <nova.api.openstack.wsgi.Resource object at 0x2b3cc50>, 'project_id': u'a843cb922df24063b50c3accdc6ded44', 'id': u'dbbc203a-9a18-493a-b3d5-da82e5232f59'} __call__ /usr/lib/python2.6/site-packages/Routes-1.12.3-py2.6.egg/routes/middleware.py:103

  2014-05-20 14:55:26.583 19351 DEBUG nova.compute.api [req-3278602c-
  d0ef-455f-af8e-a6e20447322e 161172840f564803ab4e6b2cde1f13de
  a843cb922df24063b50c3accdc6ded44] [instance: dbbc203a-9a18-493a-
  b3d5-da82e5232f59] Going to try to terminate instance delete
  /usr/lib/python2.6/site-packages/nova/compute/api.py:1564

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1323786/+subscriptions