yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #82355
[Bug 1834659] Re: Volume not removed on instance deletion
Reviewed: https://review.opendev.org/669674
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=01c334cbdd859f4e486ac2c369a4bdb3ec7709cc
Submitter: Zuul
Branch: master
commit 01c334cbdd859f4e486ac2c369a4bdb3ec7709cc
Author: Francois Palin <fpalin@xxxxxxxxxx>
Date: Mon Jul 8 10:12:25 2019 -0400
Add retry to cinder API calls related to volume detach
When shutting down an instance for which volume needs to be
deleted, if cinder RPC timeout expires before cinder volume
driver terminates connection, then an unknown cinder exception
is received and the volume is not removed.
This fix adds a retry mechanism directly in cinder API calls
attachment_delete, terminate_connection, and detach.
Change-Id: I3c9ae47d0ceb64fa3082a01cb7df27faa4f5a00d
Closes-Bug: #1834659
** Changed in: nova
Status: In Progress => Fix Released
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1834659
Title:
Volume not removed on instance deletion
Status in OpenStack Compute (nova):
Fix Released
Bug description:
Description
===========
When we deploy a non-ephemeral instance (i.e. Creating a new volume), and
indicate "YES" in "Delete Volume on Instance delete",then delete the
instance, and volume driver terminate connection in cinder takes too long
to return, the volume is not removed.
The volume status remains as "In-use" and "Attached to None on /dev/vda".
For example:
abcfa1db-1748-4f04-9a29-128cf22efcc5 - 130GiB In-use - Attached to None on /dev/vda
Steps to reproduce
==================
Please refer to this bug comment #2 below
Expected result
===============
Volume gets removed
Actual result
=============
Volume remains attached
Environment
===========
Issue was initially reported downstream against Newton release (see
comment #1 below). Customer was using hitachi volume driver:
volume_driver = cinder.volume.drivers.hitachi.hbsd.hbsd_fc.HBSDFCDriver
As a note, the hitachi drivers are unsupported as of Pike (see cinder
commit 595c8d3f8523a9612ccc64ff4147eab993493892
Issue was reproduced in a devstack environment runnning the Stein release.
Volume driver used was lvm (devstack default)
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1834659/+subscriptions
References