← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1319903] [NEW] preallocated snapshot images should not be determined by format

 

Public bug reported:

In nova, we can create a raw preallocated disk and a qcow2 preallocated
disk - both would be preallocated although the format would change.

nova.conf configured with preallocation+qcow2:

[root@orange-vdsf _base(keystone_admin)]# qemu-img info /var/lib/nova/instances/e143d1e7-d665-4129-80fd-729c2df63262/disk
image: /var/lib/nova/instances/e143d1e7-d665-4129-80fd-729c2df63262/disk
file format: qcow2
virtual size: 10G (10737418240 bytes)
disk size: 10G
cluster_size: 65536
backing file: /var/lib/nova/instances/_base/8dc2949154674d316d255dc55d411867614e6eb4
Format specific information:
    compat: 1.1
    lazy refcounts: false

nova.conf configured with preallocation and raw:

[root@orange-vdsf _base(keystone_admin)]# qemu-img info /var/lib/nova/instances/1ed7becd-4635-4ba5-a9dd-2a6c5f6f58d3/disk
image: /var/lib/nova/instances/1ed7becd-4635-4ba5-a9dd-2a6c5f6f58d3/disk
file format: raw
virtual size: 10G (10737418240 bytes)
disk size: 10G

this is a snapshot image created from a qcow2+preallocated instance

image: /var/lib/glance/images/90983f5a-08a8-48b0-a209-926e6ccfcd4f
file format: qcow2
virtual size: 10G (10737418240 bytes)
disk size: 18M
cluster_size: 65536
Format specific information:
    compat: 1.1
    lazy refcounts: false


this is a snapshot image created from a raw+preallocated instance 

[root@orange-vdsf _base(keystone_admin)]# qemu-img info /var/lib/glance/images/9fbfb9b0-f008-48b7-8684-c91eeb69406c 
image: /var/lib/glance/images/9fbfb9b0-f008-48b7-8684-c91eeb69406c
file format: raw
virtual size: 10G (10737418240 bytes)
disk size: 10G

oot@orange-vdsf _base(keystone_admin)]# glance image-show 90983f5a-08a8-48b0-a209-926e6ccfcd4f
+---------------------------------------+--------------------------------------+
| Property                              | Value                                |
+---------------------------------------+--------------------------------------+
| Property 'base_image_ref'             | 566a54a6-ff91-4546-bbf5-ad3f240e29f0 |
| Property 'image_location'             | snapshot                             |
| Property 'image_state'                | available                            |
| Property 'image_type'                 | snapshot                             |
| Property 'instance_type_ephemeral_gb' | 0                                    |
| Property 'instance_type_flavorid'     | 961b00cd-d199-416b-886a-e9f5ecafebd0 |
| Property 'instance_type_id'           | 6                                    |
| Property 'instance_type_memory_mb'    | 512                                  |
| Property 'instance_type_name'         | Dafna                                |
| Property 'instance_type_root_gb'      | 10                                   |
| Property 'instance_type_rxtx_factor'  | 1.0                                  |
| Property 'instance_type_swap'         | 0                                    |
| Property 'instance_type_vcpus'        | 1                                    |
| Property 'instance_uuid'              | e143d1e7-d665-4129-80fd-729c2df63262 |
| Property 'network_allocated'          | True                                 |
| Property 'owner_id'                   | 4ad766166539403189f2caca1ba306aa     |
| Property 'user_id'                    | c9062d562d9f41e4a1fdce36a4f176f6     |
| checksum                              | 4b92737f3e2b8b0fa239b10f895644ca     |
| container_format                      | bare                                 |
| created_at                            | 2014-05-15T15:02:44                  |
| deleted                               | False                                |
| disk_format                           | qcow2                                |
| id                                    | 90983f5a-08a8-48b0-a209-926e6ccfcd4f |
| is_public                             | False                                |
| min_disk                              | 10                                   |
| min_ram                               | 0                                    |
| name                                  | qcow_preallocated                    |
| owner                                 | 4ad766166539403189f2caca1ba306aa     |
| protected                             | False                                |
| size                                  | 19333120                             |
| status                                | active                               |
| updated_at                            | 2014-05-15T15:08:50                  |
+---------------------------------------+--------------------------------------+
[root@orange-vdsf _base(keystone_admin)]# glance image-show 9fbfb9b0-f008-48b7-8684-c91eeb69406c
+---------------------------------------+--------------------------------------+
| Property                              | Value                                |
+---------------------------------------+--------------------------------------+
| Property 'base_image_ref'             | 566a54a6-ff91-4546-bbf5-ad3f240e29f0 |
| Property 'image_location'             | snapshot                             |
| Property 'image_state'                | available                            |
| Property 'image_type'                 | snapshot                             |
| Property 'instance_type_ephemeral_gb' | 0                                    |
| Property 'instance_type_flavorid'     | 961b00cd-d199-416b-886a-e9f5ecafebd0 |
| Property 'instance_type_id'           | 6                                    |
| Property 'instance_type_memory_mb'    | 512                                  |
| Property 'instance_type_name'         | Dafna                                |
| Property 'instance_type_root_gb'      | 10                                   |
| Property 'instance_type_rxtx_factor'  | 1.0                                  |
| Property 'instance_type_swap'         | 0                                    |
| Property 'instance_type_vcpus'        | 1                                    |
| Property 'instance_uuid'              | 1ed7becd-4635-4ba5-a9dd-2a6c5f6f58d3 |
| Property 'network_allocated'          | True                                 |
| Property 'owner_id'                   | 4ad766166539403189f2caca1ba306aa     |
| Property 'user_id'                    | c9062d562d9f41e4a1fdce36a4f176f6     |
| checksum                              | 2915b40e7c707d9c996dce4b824af30d     |
| container_format                      | bare                                 |
| created_at                            | 2014-05-15T15:26:57                  |
| deleted                               | False                                |
| disk_format                           | raw                                  |
| id                                    | 9fbfb9b0-f008-48b7-8684-c91eeb69406c |
| is_public                             | False                                |
| min_disk                              | 10                                   |
| min_ram                               | 0                                    |
| name                                  | snapshot_raw                         |
| owner                                 | 4ad766166539403189f2caca1ba306aa     |
| protected                             | False                                |
| size                                  | 10737418240                          |
| status                                | active                               |
| updated_at                            | 2014-05-15T15:34:14                  |


if qcow2 can support preallocation we should be creating the snapshot
based on the nova preallocation configuration and not the instance disk
format.

** Affects: glance
     Importance: Undecided
         Status: New

** Summary changed:

- preallocated snapshot images should not be determained by format
+ preallocated snapshot images should not be determined by format

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1319903

Title:
  preallocated snapshot images should not be determined by format

Status in OpenStack Image Registry and Delivery Service (Glance):
  New

Bug description:
  In nova, we can create a raw preallocated disk and a qcow2
  preallocated disk - both would be preallocated although the format
  would change.

  nova.conf configured with preallocation+qcow2:

  [root@orange-vdsf _base(keystone_admin)]# qemu-img info /var/lib/nova/instances/e143d1e7-d665-4129-80fd-729c2df63262/disk
  image: /var/lib/nova/instances/e143d1e7-d665-4129-80fd-729c2df63262/disk
  file format: qcow2
  virtual size: 10G (10737418240 bytes)
  disk size: 10G
  cluster_size: 65536
  backing file: /var/lib/nova/instances/_base/8dc2949154674d316d255dc55d411867614e6eb4
  Format specific information:
      compat: 1.1
      lazy refcounts: false

  nova.conf configured with preallocation and raw:

  [root@orange-vdsf _base(keystone_admin)]# qemu-img info /var/lib/nova/instances/1ed7becd-4635-4ba5-a9dd-2a6c5f6f58d3/disk
  image: /var/lib/nova/instances/1ed7becd-4635-4ba5-a9dd-2a6c5f6f58d3/disk
  file format: raw
  virtual size: 10G (10737418240 bytes)
  disk size: 10G

  this is a snapshot image created from a qcow2+preallocated instance

  image: /var/lib/glance/images/90983f5a-08a8-48b0-a209-926e6ccfcd4f
  file format: qcow2
  virtual size: 10G (10737418240 bytes)
  disk size: 18M
  cluster_size: 65536
  Format specific information:
      compat: 1.1
      lazy refcounts: false

  
  this is a snapshot image created from a raw+preallocated instance 

  [root@orange-vdsf _base(keystone_admin)]# qemu-img info /var/lib/glance/images/9fbfb9b0-f008-48b7-8684-c91eeb69406c 
  image: /var/lib/glance/images/9fbfb9b0-f008-48b7-8684-c91eeb69406c
  file format: raw
  virtual size: 10G (10737418240 bytes)
  disk size: 10G

  oot@orange-vdsf _base(keystone_admin)]# glance image-show 90983f5a-08a8-48b0-a209-926e6ccfcd4f
  +---------------------------------------+--------------------------------------+
  | Property                              | Value                                |
  +---------------------------------------+--------------------------------------+
  | Property 'base_image_ref'             | 566a54a6-ff91-4546-bbf5-ad3f240e29f0 |
  | Property 'image_location'             | snapshot                             |
  | Property 'image_state'                | available                            |
  | Property 'image_type'                 | snapshot                             |
  | Property 'instance_type_ephemeral_gb' | 0                                    |
  | Property 'instance_type_flavorid'     | 961b00cd-d199-416b-886a-e9f5ecafebd0 |
  | Property 'instance_type_id'           | 6                                    |
  | Property 'instance_type_memory_mb'    | 512                                  |
  | Property 'instance_type_name'         | Dafna                                |
  | Property 'instance_type_root_gb'      | 10                                   |
  | Property 'instance_type_rxtx_factor'  | 1.0                                  |
  | Property 'instance_type_swap'         | 0                                    |
  | Property 'instance_type_vcpus'        | 1                                    |
  | Property 'instance_uuid'              | e143d1e7-d665-4129-80fd-729c2df63262 |
  | Property 'network_allocated'          | True                                 |
  | Property 'owner_id'                   | 4ad766166539403189f2caca1ba306aa     |
  | Property 'user_id'                    | c9062d562d9f41e4a1fdce36a4f176f6     |
  | checksum                              | 4b92737f3e2b8b0fa239b10f895644ca     |
  | container_format                      | bare                                 |
  | created_at                            | 2014-05-15T15:02:44                  |
  | deleted                               | False                                |
  | disk_format                           | qcow2                                |
  | id                                    | 90983f5a-08a8-48b0-a209-926e6ccfcd4f |
  | is_public                             | False                                |
  | min_disk                              | 10                                   |
  | min_ram                               | 0                                    |
  | name                                  | qcow_preallocated                    |
  | owner                                 | 4ad766166539403189f2caca1ba306aa     |
  | protected                             | False                                |
  | size                                  | 19333120                             |
  | status                                | active                               |
  | updated_at                            | 2014-05-15T15:08:50                  |
  +---------------------------------------+--------------------------------------+
  [root@orange-vdsf _base(keystone_admin)]# glance image-show 9fbfb9b0-f008-48b7-8684-c91eeb69406c
  +---------------------------------------+--------------------------------------+
  | Property                              | Value                                |
  +---------------------------------------+--------------------------------------+
  | Property 'base_image_ref'             | 566a54a6-ff91-4546-bbf5-ad3f240e29f0 |
  | Property 'image_location'             | snapshot                             |
  | Property 'image_state'                | available                            |
  | Property 'image_type'                 | snapshot                             |
  | Property 'instance_type_ephemeral_gb' | 0                                    |
  | Property 'instance_type_flavorid'     | 961b00cd-d199-416b-886a-e9f5ecafebd0 |
  | Property 'instance_type_id'           | 6                                    |
  | Property 'instance_type_memory_mb'    | 512                                  |
  | Property 'instance_type_name'         | Dafna                                |
  | Property 'instance_type_root_gb'      | 10                                   |
  | Property 'instance_type_rxtx_factor'  | 1.0                                  |
  | Property 'instance_type_swap'         | 0                                    |
  | Property 'instance_type_vcpus'        | 1                                    |
  | Property 'instance_uuid'              | 1ed7becd-4635-4ba5-a9dd-2a6c5f6f58d3 |
  | Property 'network_allocated'          | True                                 |
  | Property 'owner_id'                   | 4ad766166539403189f2caca1ba306aa     |
  | Property 'user_id'                    | c9062d562d9f41e4a1fdce36a4f176f6     |
  | checksum                              | 2915b40e7c707d9c996dce4b824af30d     |
  | container_format                      | bare                                 |
  | created_at                            | 2014-05-15T15:26:57                  |
  | deleted                               | False                                |
  | disk_format                           | raw                                  |
  | id                                    | 9fbfb9b0-f008-48b7-8684-c91eeb69406c |
  | is_public                             | False                                |
  | min_disk                              | 10                                   |
  | min_ram                               | 0                                    |
  | name                                  | snapshot_raw                         |
  | owner                                 | 4ad766166539403189f2caca1ba306aa     |
  | protected                             | False                                |
  | size                                  | 10737418240                          |
  | status                                | active                               |
  | updated_at                            | 2014-05-15T15:34:14                  |


  if qcow2 can support preallocation we should be creating the snapshot
  based on the nova preallocation configuration and not the instance
  disk format.

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1319903/+subscriptions


Follow ups

References