yahoo-eng-team team mailing list archive

["Gary W. Smith" <gary.smith@xxxxxxxx>]

This bug was last updated over 5 years ago, and as there have
been many changes to both nova and horizon since then, this is
getting marked as Invalid. If the issue still exists, please
feel free to reopen it.

** Changed in: horizon
       Status: Confirmed => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1003199

Title:
  Snapshots can fail silently

Status in Glance:
  Triaged
Status in OpenStack Dashboard (Horizon):
  Invalid

Bug description:
  If a snapshot fails when it is being created it will do so silently
  and will disappear from the snapshot list.

  Example:

  Creating a snap shot the status will go to queued then to saving. If
  saving fails eg swift backend issue in glance etc. then the snapshot
  disappears from the dashboard completely with no error message.

  
  Not sure exactly how to fix it as it involves nova and glance too. 
  On the nova-compute node that the instance is running on that is being snapshoted and error is caught eg.

  2012-05-22 05:14:31 ERROR nova.rpc.amqp [req-aa82909d-8fa2-4fae-9443-3db1411f9897 a4a0066852fe4073b65818c883b8625a 2e91ae6fe1334a8480cbb391f376db15] Exception during message handling
  2012-05-22 05:14:31 TRACE nova.rpc.amqp Traceback (most recent call last):
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 252, in _process_data
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     rval = node_func(context=ctxt, **node_args)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     return f(*args, **kw)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 177, in decorated_function
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     sys.exc_info())
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     self.gen.next()
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 171, in decorated_function
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     return function(self, context, instance_uuid, *args, **kwargs)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 946, in snapshot_instance
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     self.driver.snapshot(context, instance_ref, image_id)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     return f(*args, **kw)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 711, in snapshot
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     image_file)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 306, in update
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     _reraise_translated_image_exception(image_id)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 304, in update
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     image_meta = client.update_image(image_id, image_meta, data)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/glance/client.py", line 195, in update_image
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     res = self.do_request("PUT", "/images/%s" % image_id, body, headers)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 58, in wrapped
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     return func(self, *args, **kwargs)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 420, in do_request
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     headers=headers)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 75, in wrapped
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     return func(self, method, url, body, headers)
  2012-05-22 05:14:31 TRACE nova.rpc.amqp   File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 542, in _do_request
  2012-05-22 05:14:31 TRACE nova.rpc.amqp     raise exception.Invalid(res.read())
  2012-05-22 05:14:31 TRACE nova.rpc.amqp Invalid: Data supplied was not valid.
  2012-05-22 05:14:31 TRACE nova.rpc.amqp Details: 400 Bad Request
  2012-05-22 05:14:31 TRACE nova.rpc.amqp 
  2012-05-22 05:14:31 TRACE nova.rpc.amqp The server could not comply with the request since it is either malformed or otherwise incorrect.
  2012-05-22 05:14:31 TRACE nova.rpc.amqp 
  2012-05-22 05:14:31 TRACE nova.rpc.amqp  Error uploading image: (BackendException): Failed to add object to Swift. Got error from Swift: put_object('images', '0c6c990f-8f58-4554-b2e6-c045b4c7fb46', ...) failure and no ability to reset contents for reupload.  
  2012-05-22 05:14:31 TRACE nova.rpc.amqp 

  
  In glance the entry for the snapshot exists but it is in status 'killed' maybe I need to lodge a bug against glance too to mark it as "failed" or something and then have the ability for a client (dashboard) to see this.

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1003199/+subscriptions