yahoo-eng-team team mailing list archive

Thread
Date
[Bug 1537721] [NEW] Image corrupts when upload

To: yahoo-eng-team@xxxxxxxxxxxxxxxxxxx
From: Andrey Shestakov <ashestakov@xxxxxxxxxxxx>
Date: Mon, 25 Jan 2016 11:38:30 -0000
Reply-to: Bug 1537721 <1537721@xxxxxxxxxxxxxxxxxx>
Sender: bounces@xxxxxxxxxxxxx
Public bug reported:

After this commit https://github.com/openstack/glance_store/commit/a0572ef672512a8ed7ef203816ec256eafd5f9de
image uploads works incorrect.

Steps to reproduce:

1. Upload image (1.47GB)
md5sum virtual_ubuntu_trasty_ext4_demo 
fa9ec35d64d43aefd6356150d361ec24  virtual_ubuntu_trasty_ext4_demo

glance image-create --disk-format raw --container-format bare --file virtual_ubuntu_trasty_ext4_demo --progress --name ubuntu_upload_with_fix 
[=============================>] 100%
+------------------+--------------------------------------+
| Property         | Value                                |
+------------------+--------------------------------------+
| checksum         | fa9ec35d64d43aefd6356150d361ec24     |
| container_format | bare                                 |
| created_at       | 2016-01-25T11:06:15Z                 |
| disk_format      | raw                                  |
| id               | 5b955bce-61ab-4c55-afd9-8bd6012cf1ab |
| min_disk         | 0                                    |
| min_ram          | 0                                    |
| name             | ubuntu_upload_with_fix               |
| owner            | e885a6c5e87c45d38a274de4388241e6     |
| protected        | False                                |
| size             | 1476395008                           |
| status           | active                               |
| tags             | []                                   |
| updated_at       | 2016-01-25T11:10:49Z                 |
| virtual_size     | None                                 |
| visibility       | private                              |
+------------------+--------------------------------------+

2. It has 10 obects in Swift, but should has only one (size is less than 5G)
swift list glance
5b955bce-61ab-4c55-afd9-8bd6012cf1ab
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00001
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00002
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00003
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00004
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00005
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00006
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009

Image splitted by 7 chunks of 200MB + 1*47MB + 1 zero length chunk.
swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
       Account: v1
     Container: glance
        Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
  Content Type: binary/octet-stream
Content Length: 204800000
 Last Modified: Mon, 25 Jan 2016 11:10:42 GMT
          ETag: eda9a9889837ac4bc81d6387d92c1bec
 Accept-Ranges: bytes
        Server: Apache
   X-Timestamp: 1453720242.00000
    X-Trans-Id: tx0000000000000000da5cc-0056a6064c-5e81-default
swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
       Account: v1
     Container: glance
        Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
  Content Type: binary/octet-stream
Content Length: 42795008
 Last Modified: Mon, 25 Jan 2016 11:10:49 GMT
          ETag: f3c9b36eceea8d2192996ca931f1fa55
 Accept-Ranges: bytes
        Server: Apache
   X-Timestamp: 1453720249.00000
    X-Trans-Id: tx0000000000000000d8c0e-0056a60655-377d-default
swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009
       Account: v1
     Container: glance
        Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009
  Content Type: binary/octet-stream
Content Length: 0
 Last Modified: Mon, 25 Jan 2016 11:10:49 GMT
          ETag: d41d8cd98f00b204e9800998ecf8427e
 Accept-Ranges: bytes
        Server: Apache
   X-Timestamp: 1453720249.00000
    X-Trans-Id: tx0000000000000000da39b-0056a60660-85c1-default

3. Download image 
glance image-download 5b955bce-61ab-4c55-afd9-8bd6012cf1ab --file ubuntu_download_with_fix --progress
[=============================>] 100%[Errno 32] Corrupt image download. Checksum was 9253e738cabf6a3c0beace1a3b07e623 expected fa9ec35d64d43aefd6356150d361ec24

Image is corrupted, and original and result files has difference in lenght (1754 bytes)
ls -l virtual_ubuntu_trasty_ext4_demo 
-rw-r--r-- 1 root root 1476395008 Jan 25 11:04 virtual_ubuntu_trasty_ext4_demo
ls -l ubuntu_download_with_fix 
-rw-r--r-- 1 root root 1476393254 Jan 25 11:17 ubuntu_download_with_fix

** Affects: glance
     Importance: Undecided
         Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1537721

Title:
  Image corrupts when upload

Status in Glance:
  New

Bug description:
  After this commit https://github.com/openstack/glance_store/commit/a0572ef672512a8ed7ef203816ec256eafd5f9de
  image uploads works incorrect.

  Steps to reproduce:

  1. Upload image (1.47GB)
  md5sum virtual_ubuntu_trasty_ext4_demo 
  fa9ec35d64d43aefd6356150d361ec24  virtual_ubuntu_trasty_ext4_demo

  glance image-create --disk-format raw --container-format bare --file virtual_ubuntu_trasty_ext4_demo --progress --name ubuntu_upload_with_fix 
  [=============================>] 100%
  +------------------+--------------------------------------+
  | Property         | Value                                |
  +------------------+--------------------------------------+
  | checksum         | fa9ec35d64d43aefd6356150d361ec24     |
  | container_format | bare                                 |
  | created_at       | 2016-01-25T11:06:15Z                 |
  | disk_format      | raw                                  |
  | id               | 5b955bce-61ab-4c55-afd9-8bd6012cf1ab |
  | min_disk         | 0                                    |
  | min_ram          | 0                                    |
  | name             | ubuntu_upload_with_fix               |
  | owner            | e885a6c5e87c45d38a274de4388241e6     |
  | protected        | False                                |
  | size             | 1476395008                           |
  | status           | active                               |
  | tags             | []                                   |
  | updated_at       | 2016-01-25T11:10:49Z                 |
  | virtual_size     | None                                 |
  | visibility       | private                              |
  +------------------+--------------------------------------+

  2. It has 10 obects in Swift, but should has only one (size is less than 5G)
  swift list glance
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00001
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00002
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00003
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00004
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00005
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00006
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
  5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009

  Image splitted by 7 chunks of 200MB + 1*47MB + 1 zero length chunk.
  swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
         Account: v1
       Container: glance
          Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00007
    Content Type: binary/octet-stream
  Content Length: 204800000
   Last Modified: Mon, 25 Jan 2016 11:10:42 GMT
            ETag: eda9a9889837ac4bc81d6387d92c1bec
   Accept-Ranges: bytes
          Server: Apache
     X-Timestamp: 1453720242.00000
      X-Trans-Id: tx0000000000000000da5cc-0056a6064c-5e81-default
  swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
         Account: v1
       Container: glance
          Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00008
    Content Type: binary/octet-stream
  Content Length: 42795008
   Last Modified: Mon, 25 Jan 2016 11:10:49 GMT
            ETag: f3c9b36eceea8d2192996ca931f1fa55
   Accept-Ranges: bytes
          Server: Apache
     X-Timestamp: 1453720249.00000
      X-Trans-Id: tx0000000000000000d8c0e-0056a60655-377d-default
  swift stat glance 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009
         Account: v1
       Container: glance
          Object: 5b955bce-61ab-4c55-afd9-8bd6012cf1ab-00009
    Content Type: binary/octet-stream
  Content Length: 0
   Last Modified: Mon, 25 Jan 2016 11:10:49 GMT
            ETag: d41d8cd98f00b204e9800998ecf8427e
   Accept-Ranges: bytes
          Server: Apache
     X-Timestamp: 1453720249.00000
      X-Trans-Id: tx0000000000000000da39b-0056a60660-85c1-default

  3. Download image 
  glance image-download 5b955bce-61ab-4c55-afd9-8bd6012cf1ab --file ubuntu_download_with_fix --progress
  [=============================>] 100%[Errno 32] Corrupt image download. Checksum was 9253e738cabf6a3c0beace1a3b07e623 expected fa9ec35d64d43aefd6356150d361ec24

  Image is corrupted, and original and result files has difference in lenght (1754 bytes)
  ls -l virtual_ubuntu_trasty_ext4_demo 
  -rw-r--r-- 1 root root 1476395008 Jan 25 11:04 virtual_ubuntu_trasty_ext4_demo
  ls -l ubuntu_download_with_fix 
  -rw-r--r-- 1 root root 1476393254 Jan 25 11:17 ubuntu_download_with_fix

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1537721/+subscriptions
Follow ups

[Bug 1537721] Re: Image corrupts when upload
From: Flavio Percoco, 2016-01-28