yahoo-eng-team team mailing list archive

[Erno Kuvaja <jokke@xxxxxx>]

** Project changed: glance => glance-store

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1235386

Title:
   Failed to add object to Swift. causes glance to return 503

Status in OpenStack Glance backend store-drivers library (glance_store):
  In Progress

Bug description:
  http://logs.openstack.org/23/49623/3/check/check-tempest-devstack-vm-
  neutron/8a1a42d/logs/screen-g-api.txt.gz?#_2013-10-04_16_31_15_067

  2013-10-04 16:31:15.067 32574 ERROR glance.store.swift [7ba13d89-a2f1-4ed6-96f9-013286e74edc cafcbf642bd4498b9ca6aa7f387af5ee 03102de58497423db8082bd91188d60a] Failed to add object to Swift.
  Got error from Swift: put_object('glance', '6d938c1c-3295-4ac4-81af-630b6b906f46', ...) failure and no ability to reset contents for reupload.
  2013-10-04 16:31:15.067 32574 ERROR glance.api.v1.upload_utils [7ba13d89-a2f1-4ed6-96f9-013286e74edc cafcbf642bd4498b9ca6aa7f387af5ee 03102de58497423db8082bd91188d60a] Failed to upload image 6d938c1c-3295-4ac4-81af-630b6b906f46
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils Traceback (most recent call last):
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils   File "/opt/stack/new/glance/glance/api/v1/upload_utils.py", line 101, in upload_data_to_store
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils     store)
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils   File "/opt/stack/new/glance/glance/store/__init__.py", line 333, in store_add_to_backend
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils     (location, size, checksum, metadata) = store.add(image_id, data, size)
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils   File "/opt/stack/new/glance/glance/store/swift.py", line 447, in add
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils     raise glance.store.BackendException(msg)
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils BackendException: Failed to add object to Swift.
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils Got error from Swift: put_object('glance', '6d938c1c-3295-4ac4-81af-630b6b906f46', ...) failure and no ability to reset contents for reupload.
  2013-10-04 16:31:15.067 32574 TRACE glance.api.v1.upload_utils 

  
  logstash.openstack.org shows at least 4 cases of this in the past week

  http://logstash.openstack.org/#eyJzZWFyY2giOiJAbWVzc2FnZTpcIkdvdCBlcnJvciBmcm9tIFN3aWZ0OiBwdXRfb2JqZWN0XCIgQU5EIEBmaWVsZHMuZmlsZW5hbWU6XCJsb2dzL3NjcmVlbi1nLWFwaS50eHRcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTM4MDkwOTQ1MDAwMCwibW9kZSI6IiIsImFuYWx5emVfZmllbGQiOiIifQ==

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance-store/+bug/1235386/+subscriptions