← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #10207

[Bug 1284516] [NEW] nova-compute does not clean up inst_base_resize directory when deleting the instance during finish_resize

  Thread Previous • Date Previous • • Thread Next 
Public bug reported:

When deleting an instance during finish_resize, an exception will be
raised as following:

2014-02-25 07:51:49.913 ERROR nova.compute.manager [^[[01;36mreq-efd592fa-40c2-41a3-be20-4174c5e9317e ^[[00;36madmin admin] ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] Setting instance vm_state to ERROR^[[00m
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00mTraceback (most recent call last):
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/nova/nova/compute/manager.py", line 3312, in finish_resize
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    disk_info, image)
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/nova/nova/compute/manager.py", line 3266, in _finish_resize
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    instance.task_state = task_states.RESIZE_FINISH
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/nova/nova/objects/base.py", line 142, in wrapper
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    ctxt, self, fn.__name__, args, kwargs)
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/nova/nova/conductor/rpcapi.py", line 483, in object_action
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    objmethod=objmethod, args=args, kwargs=kwargs)
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/oslo.messaging/oslo/messaging/rpc/client.py", line 150, in call
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    wait_for_reply=True, timeout=timeout)
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/oslo.messaging/oslo/messaging/transport.py", line 87, in _send
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    timeout=timeout)
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/oslo.messaging/oslo/messaging/_drivers/amqpdriver.py", line 390, in send
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    return self._send(target, ctxt, message, wait_for_reply, timeout)
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/oslo.messaging/oslo/messaging/_drivers/amqpdriver.py", line 383, in _send
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    raise result
2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00mUnexpectedDeletingTaskStateError_Remote: Unexpected task state: expecting (u'resize_migrated',) but the actual state is deleting


When this exception happens, resize process is over. And the inst_base_resize directory are not cleaned up and remain forever.

** Affects: nova
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1284516

Title:
  nova-compute does not clean up inst_base_resize directory when
  deleting the instance during finish_resize

Status in OpenStack Compute (Nova):
  New

Bug description:
  When deleting an instance during finish_resize, an exception will be
  raised as following:

  2014-02-25 07:51:49.913 ERROR nova.compute.manager [^[[01;36mreq-efd592fa-40c2-41a3-be20-4174c5e9317e ^[[00;36madmin admin] ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] Setting instance vm_state to ERROR^[[00m
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00mTraceback (most recent call last):
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/nova/nova/compute/manager.py", line 3312, in finish_resize
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    disk_info, image)
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/nova/nova/compute/manager.py", line 3266, in _finish_resize
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    instance.task_state = task_states.RESIZE_FINISH
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/nova/nova/objects/base.py", line 142, in wrapper
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    ctxt, self, fn.__name__, args, kwargs)
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/nova/nova/conductor/rpcapi.py", line 483, in object_action
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    objmethod=objmethod, args=args, kwargs=kwargs)
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/oslo.messaging/oslo/messaging/rpc/client.py", line 150, in call
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    wait_for_reply=True, timeout=timeout)
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/oslo.messaging/oslo/messaging/transport.py", line 87, in _send
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    timeout=timeout)
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/oslo.messaging/oslo/messaging/_drivers/amqpdriver.py", line 390, in send
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    return self._send(target, ctxt, message, wait_for_reply, timeout)
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m  File "/opt/stack/oslo.messaging/oslo/messaging/_drivers/amqpdriver.py", line 383, in _send
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00m    raise result
  2014-02-25 07:51:49.913 TRACE nova.compute.manager ^[[01;35m[instance: f0135c05-cd86-4aad-8880-625d2a2ee960] ^[[00mUnexpectedDeletingTaskStateError_Remote: Unexpected task state: expecting (u'resize_migrated',) but the actual state is deleting

  
  When this exception happens, resize process is over. And the inst_base_resize directory are not cleaned up and remain forever.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1284516/+subscriptions

Follow ups

References

  Thread Previous • Date Previous • • Thread Next