yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1455460] [NEW] resize server fails silently

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Timofey Durakov <tdurakov@xxxxxxxxxxxx>
Date: Fri, 15 May 2015 11:30:42 -0000
Reply-to: Bug 1455460 <1455460@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Attempt to resize instance from bigger flavor to smaller fails, but no
user notification in cli happened:

root@node-7:~# nova resize --poll a4 1

Server resizing... 100% complete

while nova-compute.log has trace:
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 137, in _dispatch_and_reply
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 180, in _dispatch
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 126, in _do_dispatch
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     payload)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return f(self, context, *args, **kw)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 298, in decorated_function
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     pass
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 284, in decorated_function
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 348, in decorated_function
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 272, in decorated_function
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     migration.instance_uuid, exc_info=True)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 259, in decorated_function
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 326, in decorated_function
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     kwargs['instance'], e, sys.exc_info())
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 82, in __exit__
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 314, in decorated_function
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3795, in resize_instance
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     self.instance_events.clear_events_for_instance(instance)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     self.gen.throw(type, value, traceback)
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 6123, in _error_out_instance_on_exception
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     raise error.inner_exception
2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher ResizeError: Resize error: Unable to resize disk down.

User should be notified about such fail.

** Affects: nova
     Importance: Undecided
         Status: New


** Tags: error-handling resize

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1455460

Title:
  resize server fails silently

Status in OpenStack Compute (Nova):
  New

Bug description:
  Attempt to resize instance from bigger flavor to smaller fails, but no
  user notification in cli happened:

  root@node-7:~# nova resize --poll a4 1

  Server resizing... 100% complete

  while nova-compute.log has trace:
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher Traceback (most recent call last):
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 137, in _dispatch_and_reply
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     incoming.message))
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 180, in _dispatch
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return self._do_dispatch(endpoint, method, ctxt, args)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/oslo/messaging/rpc/dispatcher.py", line 126, in _do_dispatch
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     result = getattr(endpoint, method)(ctxt, **new_args)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 88, in wrapped
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     payload)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 82, in __exit__
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 71, in wrapped
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return f(self, context, *args, **kw)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 298, in decorated_function
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     pass
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 82, in __exit__
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 284, in decorated_function
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 348, in decorated_function
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 272, in decorated_function
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     migration.instance_uuid, exc_info=True)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 82, in __exit__
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 259, in decorated_function
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 326, in decorated_function
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     kwargs['instance'], e, sys.exc_info())
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/excutils.py", line 82, in __exit__
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     six.reraise(self.type_, self.value, self.tb)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 314, in decorated_function
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     return function(self, context, *args, **kwargs)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 3795, in resize_instance
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     self.instance_events.clear_events_for_instance(instance)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/contextlib.py", line 35, in __exit__
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     self.gen.throw(type, value, traceback)
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 6123, in _error_out_instance_on_exception
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher     raise error.inner_exception
  2015-05-15 09:39:45.968 32005 TRACE oslo.messaging.rpc.dispatcher ResizeError: Resize error: Unable to resize disk down.

  User should be notified about such fail.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1455460/+subscriptions
Follow ups

[Bug 1455460] Re: resize server fails silently
From: Charlotte Han, 2016-06-02
[Bug 1455460] [NEW] resize server fails silently
From: Timofey Durakov, 2015-05-15
References

[Bug 1455460] [NEW] resize server fails silently
From: Timofey Durakov, 2015-05-15