← Back to team overview

yahoo-eng-team team mailing list archive

  1. yahoo-eng-team team
  2. Mailing list archive
  3. Message #18907

[Bug 1172695] Re: Instance stuck in ACTIVE/deleting if detach volume failure

  Thread Previous • Date Previous • • Thread Next 
I'm going to mark this as Won't Fix as the submitter has confirmed this
is no longer an issue in icehouse (thanks MotoKen!).

** Changed in: nova
   Importance: Medium => Undecided

** Changed in: nova
       Status: Confirmed => Won't Fix

** Changed in: nova
     Assignee: Rohit Karajgi (rohitk) => (unassigned)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1172695

Title:
  Instance stuck in ACTIVE/deleting if detach volume failure

Status in OpenStack Compute (Nova):
  Won't Fix

Bug description:
  When deleting an Instance with attached volume, it stuck in
  ACTIVE/deleting status if detach volume failure.

  To reproduce:
  1. boot an instance and attach a volume.
  2. stop cinder-api
  3. delete the instance
  4. instance stuck in ACTIVE/deleting

  Traceback:
  2013-04-25 20:13:58.348 ERROR nova.openstack.common.rpc.amqp [req-14043ff3-79d0-4c6c-9394-9ac8f53c84d5 1458120d63784bb49858437c275dc59e 7dd8607e7d294efc845ccf68f8d282b7] Exception during message handling
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last):
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line 430, in _process_data
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     rval = self.proxy.dispatch(ctxt, version, method, **args)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", line 133, in dispatch
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     return getattr(proxyobj, method)(ctxt, **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     temp_level, payload)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 94, in wrapped
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     return f(self, context, *args, **kw)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 260, in decorated_function
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     function(self, context, *args, **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 237, in decorated_function
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     e, sys.exc_info())
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 224, in decorated_function
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     return function(self, context, *args, **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1383, in terminate_instance
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     do_terminate_instance(instance, bdms)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/openstack/common/lockutils.py", line 242, in inner
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     retval = f(*args, **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1375, in do_terminate_instance
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     reservations=reservations)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/hooks.py", line 85, in inner
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     rv = f(*args, **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1338, in _delete_instance
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     project_id=project_id)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     self.gen.next()
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1311, in _delete_instance
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     self._shutdown_instance(context, instance, bdms)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 1259, in _shutdown_instance
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     volume = self.volume_api.get(context, bdm['volume_id'])
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/volume/cinder.py", line 193, in get
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     self._reraise_translated_volume_exception(volume_id)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/volume/cinder.py", line 190, in get
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     item = cinderclient(context).volumes.get(volume_id)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/cinderclient/v1/volumes.py", line 164, in get
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     return self._get("/volumes/%s" % volume_id, "volume")
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/cinderclient/base.py", line 141, in _get
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     resp, body = self.api.client.get(url)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 189, in get
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     return self._cs_request(url, 'GET', **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 157, in _cs_request
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/cinderclient/client.py", line 127, in request
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/requests/api.py", line 40, in request
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     return s.request(method=method, url=url, **kwargs)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/requests/sessions.py", line 229, in request
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     r.send(prefetch=prefetch)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp   File "/usr/lib/python2.7/dist-packages/requests/models.py", line 605, in send
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp     raise ConnectionError(e)
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp ConnectionError: HTTPConnectionPool(host='127.0.0.1', port=8776): Max retries exceeded with url: /v1/7dd8607e7d294efc845ccf68f8d282b7/volumes/71e67805-8380-4971-952f-9091997b3a6b
  2013-04-25 20:13:58.348 18464 TRACE nova.openstack.common.rpc.amqp

  
  When exception is raised during detaching volume then the instance stuck in ACTIVE(deleting). The instance should probably go to ERROR.

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1172695/+subscriptions
  Thread Previous • Date Previous • • Thread Next