← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1316373] [NEW] Can't force delete an errored instance with no info cache

 

Public bug reported:

Sometimes when an instance fails to launch for some reason when trying
to delete it using nova delete or nova force-delete it doesn't work and
gives the following error:

This is when using cells but I think it possibly isn't cells related.
Deleting is expecting an info cache no matter what. Ideally force delete
should ignore all errors and delete the instance.


2014-05-06 10:48:58.368 21210 ERROR nova.cells.messaging [req-a74c59d3-dc58-4318-87e8-0da15ca2a78d d1fa8867e42444cf8724e65fef1da549 094ae1e2c08f4eddb444a9d9db71ab40] Error processing message locally: Info cache for instance bb07522b-d705-4fc8-8045-e12de2affe2e could not be found.
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging Traceback (most recent call last):
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/cells/messaging.py", line 200, in _process_locally
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     resp_value = self.msg_runner._process_message_locally(self)
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/cells/messaging.py", line 1532, in _process_message_locally
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     return fn(message, **message.method_kwargs)
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/cells/messaging.py", line 894, in terminate_instance
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     self._call_compute_api_with_obj(message.ctxt, instance, 'delete')
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/cells/messaging.py", line 855, in _call_compute_api_with_obj
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     instance.refresh(ctxt)
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/base.py", line 151, in wrapper
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     return fn(self, ctxt, *args, **kwargs)
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/instance.py", line 500, in refresh
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     self.info_cache.refresh()
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/base.py", line 151, in wrapper
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     return fn(self, ctxt, *args, **kwargs)
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/instance_info_cache.py", line 103, in refresh
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     self.instance_uuid)
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/base.py", line 112, in wrapper
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     result = fn(cls, context, *args, **kwargs)
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/instance_info_cache.py", line 70, in get_by_instance_uuid
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     instance_uuid=instance_uuid)
2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging InstanceInfoCacheNotFound: Info cache for instance bb07522b-d705-4fc8-8045-e12de2affe2e could not be found.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1316373

Title:
  Can't force delete an errored instance with no info cache

Status in OpenStack Compute (Nova):
  New

Bug description:
  Sometimes when an instance fails to launch for some reason when trying
  to delete it using nova delete or nova force-delete it doesn't work
  and gives the following error:

  This is when using cells but I think it possibly isn't cells related.
  Deleting is expecting an info cache no matter what. Ideally force
  delete should ignore all errors and delete the instance.

  
  2014-05-06 10:48:58.368 21210 ERROR nova.cells.messaging [req-a74c59d3-dc58-4318-87e8-0da15ca2a78d d1fa8867e42444cf8724e65fef1da549 094ae1e2c08f4eddb444a9d9db71ab40] Error processing message locally: Info cache for instance bb07522b-d705-4fc8-8045-e12de2affe2e could not be found.
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging Traceback (most recent call last):
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/cells/messaging.py", line 200, in _process_locally
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     resp_value = self.msg_runner._process_message_locally(self)
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/cells/messaging.py", line 1532, in _process_message_locally
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     return fn(message, **message.method_kwargs)
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/cells/messaging.py", line 894, in terminate_instance
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     self._call_compute_api_with_obj(message.ctxt, instance, 'delete')
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/cells/messaging.py", line 855, in _call_compute_api_with_obj
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     instance.refresh(ctxt)
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/base.py", line 151, in wrapper
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     return fn(self, ctxt, *args, **kwargs)
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/instance.py", line 500, in refresh
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     self.info_cache.refresh()
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/base.py", line 151, in wrapper
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     return fn(self, ctxt, *args, **kwargs)
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/instance_info_cache.py", line 103, in refresh
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     self.instance_uuid)
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/base.py", line 112, in wrapper
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     result = fn(cls, context, *args, **kwargs)
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging   File "/opt/nova/nova/objects/instance_info_cache.py", line 70, in get_by_instance_uuid
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging     instance_uuid=instance_uuid)
  2014-05-06 10:48:58.368 21210 TRACE nova.cells.messaging InstanceInfoCacheNotFound: Info cache for instance bb07522b-d705-4fc8-8045-e12de2affe2e could not be found.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1316373/+subscriptions


Follow ups

References