← Back to team overview

yahoo-eng-team team mailing list archive

[Bug 1518431] Re: Glance failed to upload image to swift storage

 

Stuart, Kairat,

This bug is hard to reproduce, TBH. The race happens in a combination of
Glance's v2 behavior and swift's driver. This is not *entirely* Glance's
fault, though. The Glance "weird" part is not being able to recognize
"0-sized" chunks before submitting them. However, this is being
refactored a bit by one of our current swift specs (need to find the
link).

The swift issue is that the DELETE is hitting the swift node before the
last chunk is written/available. This could be caused by unsynchronized
clocks or just a race condition.

I've managed to reproduce it in one of our installers CI systems with
some frequency but I have yet to find a deterministic way to do so.
Meanwhile, I can confirm this issue exists.

While it's true that part of this code is being refactored by the
"buffered chunk writer" spec, I still think we should fix it as it's
eligible for backport.

Hope the above helps clarifying a bit the real problem

** Also affects: glance/liberty
   Importance: Undecided
       Status: New

** Changed in: glance
   Importance: Undecided => Medium

** Changed in: glance/liberty
   Importance: Undecided => Medium

** Changed in: glance/liberty
       Status: New => Triaged

** Changed in: glance/liberty
     Assignee: (unassigned) => Cyril Roelandt (cyril-roelandt)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1518431

Title:
  Glance failed to upload image to swift storage

Status in Glance:
  In Progress
Status in Glance liberty series:
  Triaged

Bug description:
  When glance configured with swift backend, and swift API provides via
  RadosGW is unable to upload image.

  Command:
  glance --debug image-create --name trusty_ext4 --disk-format raw --container-format bare --file trusty-server-cloudimg-amd64.img --visibility public --progress
  Logs:
  http://paste.openstack.org/show/479621/

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1518431/+subscriptions


References