yahoo-eng-team team mailing list archive

[Flavio Percoco <1537721@xxxxxxxxxxxxxxxxxx>]

** Also affects: glance/liberty
   Importance: Undecided
       Status: New

** Changed in: glance
   Importance: Undecided => High

** Changed in: glance/liberty
   Importance: Undecided => High

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1537721

Title:
  Image corrupts when upload

Status in Glance:
  In Progress
Status in Glance liberty series:
  New

Bug description:
  After this commit https://github.com/openstack/glance_store/commit/a0572ef672512a8ed7ef203816ec256eafd5f9de
  image uploads works incorrect.

  Steps to reproduce:

  1. Upload image (1.47GB)
  md5sum virtual_ubuntu_trasty_ext4_demo 
  fa9ec35d64d43aefd6356150d361ec24  virtual_ubuntu_trasty_ext4_demo

  glance image-create --disk-format raw --container-format bare --file virtual_ubuntu_trasty_ext4_demo --progress --name ubuntu_upload_with_fix 
  [=============================>] 100%
  +------------------+--------------------------------------+
  | Property         | Value                                |
  +------------------+--------------------------------------+
  | checksum         | fa9ec35d64d43aefd6356150d361ec24     |
  | container_format | bare                                 |
  | created_at       | 2016-01-25T11:06:15Z                 |
  | disk_format      | raw                                  |
  | id               | 5b955bce-61ab-4c55-afd9-8bd6012cf1ab |
  | min_disk         | 0                                    |
  | min_ram          | 0                                    |
  | name             | ubuntu_upload_with_fix               |
  | owner            | e885a6c5e87c45d38a274de4388241e6     |
  | protected        | False                                |
  | size             | 1476395008                           |
  | status           | active                               |
  | tags             | []                                   |
  | updated_at       | 2016-01-25T11:10:49Z                 |
  | virtual_size     | None                                 |
  | visibility       | private                              |
  +------------------+--------------------------------------+

  2. It has 10 obects in Swift, but should has only one (size is less than 5G)
  swift list glance
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00001
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00002
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00003
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00004
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00005
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00006
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009

  Image splitted by 7 chunks of 200MB + 1*47MB + 1 zero length chunk.
  swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
         Account: v1
       Container: glance
          Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
    Content Type: binary/octet-stream
  Content Length: 204800000
   Last Modified: Mon, 25 Jan 2016 11:10:42 GMT
            ETag: eda9a9889837ac4bc81d6387d92c1bec
   Accept-Ranges: bytes
          Server: Apache
     X-Timestamp: 1453720242.00000
      X-Trans-Id: tx0000000000000000da5cc-0056a6064c-5e81-default
  swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
         Account: v1
       Container: glance
          Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
    Content Type: binary/octet-stream
  Content Length: 42795008
   Last Modified: Mon, 25 Jan 2016 11:10:49 GMT
            ETag: f3c9b36eceea8d2192996ca931f1fa55
   Accept-Ranges: bytes
          Server: Apache
     X-Timestamp: 1453720249.00000
      X-Trans-Id: tx0000000000000000d8c0e-0056a60655-377d-default
  swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009
         Account: v1
       Container: glance
          Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009
    Content Type: binary/octet-stream
  Content Length: 0
   Last Modified: Mon, 25 Jan 2016 11:10:49 GMT
            ETag: d41d8cd98f00b204e9800998ecf8427e
   Accept-Ranges: bytes
          Server: Apache
     X-Timestamp: 1453720249.00000
      X-Trans-Id: tx0000000000000000da39b-0056a60660-85c1-default

  3. Download image 
  glance image-download 5b955bce-61ab-4c55-afd9-8bd6012cf1ab --file ubuntu_download_with_fix --progress
  [=============================>] 100%[Errno 32] Corrupt image download. Checksum was 9253e738cabf6a3c0beace1a3b07e623 expected fa9ec35d64d43aefd6356150d361ec24

  Image is corrupted, and original and result files has difference in lenght (1754 bytes)
  ls -l virtual_ubuntu_trasty_ext4_demo 
  -rw-r--r-- 1 root root 1476395008 Jan 25 11:04 virtual_ubuntu_trasty_ext4_demo
  ls -l ubuntu_download_with_fix 
  -rw-r--r-- 1 root root 1476393254 Jan 25 11:17 ubuntu_download_with_fix

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1537721/+subscriptions