yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1404617] [NEW] glance with rbd store fails to delete an image

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Yogev Rabl <yrabl@xxxxxxxxxx>
Date: Sun, 21 Dec 2014 08:10:37 -0000
Reply-to: Bug 1404617 <1404617@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

Description of problem:
The deletion of an image fails when Glance is configured to work with RBD store, with the configuration settings that are described in this manual: 
http://docs.ceph.com/docs/master/rbd/rbd-openstack/#juno

It seems like the glance client is stuck.


The CLI debug show:

# glance --debug image-delete 1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8
curl -i -X HEAD -H 'User-Agent: python-glanceclient' -H 'Content-Type: application/octet-stream' -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'X-Auth-Token: {SHA1}63a8f4dccb8c42cc741bb638c08fc19dd9ccd360' http://10.35.160.133:9292/v1/images/1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8

HTTP/1.1 200 OK
content-length: 0
x-image-meta-id: 1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8
x-image-meta-deleted: False
x-image-meta-container_format: bare
x-image-meta-checksum: 78e6077fcda0c474d42e2811c51e791f
x-image-meta-protected: False
x-image-meta-min_disk: 0
x-image-meta-min_ram: 0
x-image-meta-created_at: 2014-12-21T07:48:22
x-image-meta-size: 41126400
x-image-meta-status: active
etag: 78e6077fcda0c474d42e2811c51e791f
x-image-meta-is_public: True
date: Sun, 21 Dec 2014 07:48:50 GMT
x-image-meta-owner: fb7cd4084c6d4262a94d406f8418d155
x-image-meta-updated_at: 2014-12-21T07:48:29
content-type: text/html; charset=UTF-8
x-openstack-request-id: req-c6975244-6e0d-4b69-8a95-d3703c226a37
x-image-meta-disk_format: raw
x-image-meta-name: cirros-to-delete

curl -i -X HEAD -H 'User-Agent: python-glanceclient' -H 'Content-Type:
application/octet-stream' -H 'Accept-Encoding: gzip, deflate' -H
'Accept: */*' -H 'X-Auth-Token:
{SHA1}63a8f4dccb8c42cc741bb638c08fc19dd9ccd360'
http://10.35.160.133:9292/v1/images/1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8

HTTP/1.1 200 OK
content-length: 0
x-image-meta-id: 1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8
x-image-meta-deleted: False
x-image-meta-container_format: bare
x-image-meta-checksum: 78e6077fcda0c474d42e2811c51e791f
x-image-meta-protected: False
x-image-meta-min_disk: 0
x-image-meta-min_ram: 0
x-image-meta-created_at: 2014-12-21T07:48:22
x-image-meta-size: 41126400
x-image-meta-status: active
etag: 78e6077fcda0c474d42e2811c51e791f
x-image-meta-is_public: True
date: Sun, 21 Dec 2014 07:48:50 GMT
x-image-meta-owner: fb7cd4084c6d4262a94d406f8418d155
x-image-meta-updated_at: 2014-12-21T07:48:29
content-type: text/html; charset=UTF-8
x-openstack-request-id: req-b4808dc5-1aa1-4df0-b70f-4604355b5fba
x-image-meta-disk_format: raw
x-image-meta-name: cirros-to-delete

curl -i -X DELETE -H 'User-Agent: python-glanceclient' -H 'Content-Type: application/octet-stream' -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'X-Auth-Token: {SHA1}63a8f4dccb8c42cc741bb638c08fc19dd9ccd360' http://10.35.160.133:9292/v1/images/1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8
Version-Release number of selected component (if applicable):


How reproducible:
100%

Steps to Reproduce:
1. Create a new image
2. Delete the image


Actual results:
The image deletion fails. The data is not been deleted from the Ceph storage

Expected results:
The image should be deleted

** Affects: glance
     Importance: Undecided
         Status: New


** Tags: rbd

** Attachment added: "glance's log"
   https://bugs.launchpad.net/bugs/1404617/+attachment/4285072/+files/glance-image-delete-fail.log

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1404617

Title:
  glance with rbd store fails to delete an image

Status in OpenStack Image Registry and Delivery Service (Glance):
  New

Bug description:
  Description of problem:
  The deletion of an image fails when Glance is configured to work with RBD store, with the configuration settings that are described in this manual: 
  http://docs.ceph.com/docs/master/rbd/rbd-openstack/#juno

  It seems like the glance client is stuck.

  
  The CLI debug show:

  # glance --debug image-delete 1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8
  curl -i -X HEAD -H 'User-Agent: python-glanceclient' -H 'Content-Type: application/octet-stream' -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'X-Auth-Token: {SHA1}63a8f4dccb8c42cc741bb638c08fc19dd9ccd360' http://10.35.160.133:9292/v1/images/1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8

  HTTP/1.1 200 OK
  content-length: 0
  x-image-meta-id: 1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8
  x-image-meta-deleted: False
  x-image-meta-container_format: bare
  x-image-meta-checksum: 78e6077fcda0c474d42e2811c51e791f
  x-image-meta-protected: False
  x-image-meta-min_disk: 0
  x-image-meta-min_ram: 0
  x-image-meta-created_at: 2014-12-21T07:48:22
  x-image-meta-size: 41126400
  x-image-meta-status: active
  etag: 78e6077fcda0c474d42e2811c51e791f
  x-image-meta-is_public: True
  date: Sun, 21 Dec 2014 07:48:50 GMT
  x-image-meta-owner: fb7cd4084c6d4262a94d406f8418d155
  x-image-meta-updated_at: 2014-12-21T07:48:29
  content-type: text/html; charset=UTF-8
  x-openstack-request-id: req-c6975244-6e0d-4b69-8a95-d3703c226a37
  x-image-meta-disk_format: raw
  x-image-meta-name: cirros-to-delete

  curl -i -X HEAD -H 'User-Agent: python-glanceclient' -H 'Content-Type:
  application/octet-stream' -H 'Accept-Encoding: gzip, deflate' -H
  'Accept: */*' -H 'X-Auth-Token:
  {SHA1}63a8f4dccb8c42cc741bb638c08fc19dd9ccd360'
  http://10.35.160.133:9292/v1/images/1fc6297a-
  6c35-4c96-bcb1-9e9d8adee5e8

  HTTP/1.1 200 OK
  content-length: 0
  x-image-meta-id: 1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8
  x-image-meta-deleted: False
  x-image-meta-container_format: bare
  x-image-meta-checksum: 78e6077fcda0c474d42e2811c51e791f
  x-image-meta-protected: False
  x-image-meta-min_disk: 0
  x-image-meta-min_ram: 0
  x-image-meta-created_at: 2014-12-21T07:48:22
  x-image-meta-size: 41126400
  x-image-meta-status: active
  etag: 78e6077fcda0c474d42e2811c51e791f
  x-image-meta-is_public: True
  date: Sun, 21 Dec 2014 07:48:50 GMT
  x-image-meta-owner: fb7cd4084c6d4262a94d406f8418d155
  x-image-meta-updated_at: 2014-12-21T07:48:29
  content-type: text/html; charset=UTF-8
  x-openstack-request-id: req-b4808dc5-1aa1-4df0-b70f-4604355b5fba
  x-image-meta-disk_format: raw
  x-image-meta-name: cirros-to-delete

  curl -i -X DELETE -H 'User-Agent: python-glanceclient' -H 'Content-Type: application/octet-stream' -H 'Accept-Encoding: gzip, deflate' -H 'Accept: */*' -H 'X-Auth-Token: {SHA1}63a8f4dccb8c42cc741bb638c08fc19dd9ccd360' http://10.35.160.133:9292/v1/images/1fc6297a-6c35-4c96-bcb1-9e9d8adee5e8
  Version-Release number of selected component (if applicable):

  
  How reproducible:
  100%

  Steps to Reproduce:
  1. Create a new image
  2. Delete the image

  
  Actual results:
  The image deletion fails. The data is not been deleted from the Ceph storage

  Expected results:
  The image should be deleted

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1404617/+subscriptions
Follow ups

[Bug 1404617] [NEW] glance with rbd store fails to delete an image
From: Yogev Rabl, 2014-12-21
References

[Bug 1404617] [NEW] glance with rbd store fails to delete an image
From: Yogev Rabl, 2014-12-21