← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1834659] Re: Volume not removed on instance deletion

 

Reviewed:  https://review.opendev.org/669674
Committed: https://git.openstack.org/cgit/openstack/nova/commit/?id=01c334cbdd859f4e486ac2c369a4bdb3ec7709cc
Submitter: Zuul
Branch:    master

commit 01c334cbdd859f4e486ac2c369a4bdb3ec7709cc
Author: Francois Palin <fpalin@xxxxxxxxxx>
Date:   Mon Jul 8 10:12:25 2019 -0400

    Add retry to cinder API calls related to volume detach
    
    When shutting down an instance for which volume needs to be
    deleted, if cinder RPC timeout expires before cinder volume
    driver terminates connection, then an unknown cinder exception
    is received and the volume is not removed.
    
    This fix adds a retry mechanism directly in cinder API calls
    attachment_delete, terminate_connection, and detach.
    
    Change-Id: I3c9ae47d0ceb64fa3082a01cb7df27faa4f5a00d
    Closes-Bug: #1834659


** Changed in: nova
       Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1834659

Title:
  Volume not removed on instance deletion

Status in OpenStack Compute (nova):
  Fix Released

Bug description:
  Description
  ===========
  When we deploy a non-ephemeral instance (i.e. Creating a new volume), and 
  indicate "YES" in "Delete Volume on Instance delete",then delete the 
  instance, and volume driver terminate connection in cinder takes too long 
  to return, the volume is not removed.

  The volume status remains as "In-use" and "Attached to None on /dev/vda".
  For example:
  abcfa1db-1748-4f04-9a29-128cf22efcc5	- 130GiB In-use - Attached to None on /dev/vda

  Steps to reproduce
  ==================
  Please refer to this bug comment #2 below

  Expected result
  ===============
  Volume gets removed

  Actual result
  =============
  Volume remains attached

  Environment
  ===========
  Issue was initially reported downstream against Newton release (see 
  comment #1 below). Customer was using hitachi volume driver:
     volume_driver = cinder.volume.drivers.hitachi.hbsd.hbsd_fc.HBSDFCDriver
  As a note, the hitachi drivers are unsupported as of Pike (see cinder 
  commit 595c8d3f8523a9612ccc64ff4147eab993493892

  Issue was reproduced in a devstack environment runnning the Stein release.
  Volume driver used was lvm (devstack default)

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1834659/+subscriptions


References