yahoo-eng-team team mailing list archive
-
yahoo-eng-team team
-
Mailing list archive
-
Message #51881
[Bug 1043148] Re: snapshots fail with client read timeout when using swift
Closing this bug based Sam's comment.
** Changed in: nova
Status: Incomplete => Invalid
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1043148
Title:
snapshots fail with client read timeout when using swift
Status in OpenStack Compute (nova):
Invalid
Bug description:
Apologies if this is a glance or swift bug (or not a bug at all!) but
I think I've nailed it down to nova.
Setup:
* We are using latest nova in ubuntu precise.
* using swift as a backend to glance
* Compute nodes are running nova-compute and nova-network (have 10G ethernet)
* glance-api and swift-proxy are installed on the same host. (also has 10G ethernet)
When snapshotting instances we regularly get the snapshot failing.
Sometimes it works, sometimes it fails adding the 1st hunk and
sometimes it fails after a few.
Logs below show it failing after 34 hunks have been added to swift
successfully (takes around 3 seconds to PUT a hunk until the error)
The reason I think this has something to do with nova is that I can
successfully use the glance client from the compute node to upload the
image.
There's a lot of log info below, happy to provide more information if
needed. It been bugging us for sometime.
I think the client read timeout is between glance and nova as glance
and swift are on the same host so I would doubt they would timeout.
Thanks in advance.
Sam
Nova:
2012-08-29 07:33:08 ERROR nova.rpc.amqp [req-33589abd-db75-4a1f-b36c-a64f41e8862f 25 23] Exception during message handling
2012-08-29 07:33:08 TRACE nova.rpc.amqp Traceback (most recent call last):
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/rpc/amqp.py", line 253, in _process_data
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'args': {u'backup_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp u'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp u'image_type': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp u'instance_uuid': u'2fb5ba40-0f61-4360-bb57-f28871f7cebf',
2012-08-29 07:33:08 TRACE nova.rpc.amqp u'rotation': None},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'ctxt': <nova.rpc.amqp.RpcContext object at 0x3f27150>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'e': Invalid(Invalid(),),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'method': u'snapshot_instance',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'node_args': {'backup_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_type': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance_uuid': u'2fb5ba40-0f61-4360-bb57-f28871f7cebf',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'rotation': None},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'node_func': <bound method ComputeManager.snapshot_instance of <nova.compute.manager.ComputeManager object at 0x7f63192f4a90>>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <nova.rpc.amqp.ProxyCallback object at 0x3e48d10>}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'args': (<nova.compute.manager.ComputeManager object at 0x7f63192f4a90>,),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'e': Invalid(Invalid(),),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'event_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'exc_info': (<class 'nova.exception.Invalid'>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp Invalid(Invalid(),),
2012-08-29 07:33:08 TRACE nova.rpc.amqp <traceback object at 0x4050d88>),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'f': <function snapshot_instance at 0x1f28500>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kw': {'backup_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'context': <nova.rpc.amqp.RpcContext object at 0x3f27150>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_type': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance_uuid': u'2fb5ba40-0f61-4360-bb57-f28871f7cebf',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'rotation': None},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'level': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'notifier': <module 'nova.notifier.api' from '/usr/lib/python2.7/dist-packages/nova/notifier/api.pyc'>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'payload': {'args': (<nova.compute.manager.ComputeManager object at 0x7f63192f4a90>,),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'backup_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'context': <nova.rpc.amqp.RpcContext object at 0x3f27150>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'exception': Invalid(Invalid(),),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_type': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance_uuid': u'2fb5ba40-0f61-4360-bb57-f28871f7cebf',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'rotation': None},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'publisher_id': 'compute.np-rcc6',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'temp_level': 'ERROR',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'temp_type': 'snapshot_instance'}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 183, in decorated_function
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'args': (),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'context': <nova.rpc.amqp.RpcContext object at 0x3f27150>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'e': Invalid(Invalid(),),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'function': <function snapshot_instance at 0x1f28488>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance_uuid': u'2fb5ba40-0f61-4360-bb57-f28871f7cebf',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kwargs': {'backup_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_type': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'rotation': None},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <nova.compute.manager.ComputeManager object at 0x7f63192f4a90>}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'self': <contextlib.GeneratorContextManager object at 0x47500d0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'traceback': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'value': None}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 177, in decorated_function
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'args': (),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'context': <nova.rpc.amqp.RpcContext object at 0x3f27150>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'e': Invalid(Invalid(),),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'function': <function snapshot_instance at 0x1f28488>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance_uuid': u'2fb5ba40-0f61-4360-bb57-f28871f7cebf',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kwargs': {'backup_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_type': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'rotation': None},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <nova.compute.manager.ComputeManager object at 0x7f63192f4a90>}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 965, in snapshot_instance
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'backup_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'context': <nova.rpc.amqp.RpcContext object at 0x3f4bb50>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'current_power_state': 1,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_type': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance_ref': <nova.db.sqlalchemy.models.Instance object at 0x446fe90>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance_uuid': u'2fb5ba40-0f61-4360-bb57-f28871f7cebf',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'rotation': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <nova.compute.manager.ComputeManager object at 0x7f63192f4a90>}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/exception.py", line 114, in wrapped
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'args': (<nova.virt.libvirt.connection.LibvirtConnection object at 0x238fdd0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp <nova.rpc.amqp.RpcContext object at 0x3f4bb50>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp <nova.db.sqlalchemy.models.Instance object at 0x446fe90>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a'),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'e': Invalid(Invalid(),),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'event_type': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'exc_info': (<class 'nova.exception.Invalid'>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp Invalid(Invalid(),),
2012-08-29 07:33:08 TRACE nova.rpc.amqp <traceback object at 0x3bd0638>),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'f': <function snapshot at 0x21101b8>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kw': {},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'level': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'notifier': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'publisher_id': None}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/virt/libvirt/connection.py", line 714, in snapshot
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'_cpus': 2,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_image_service': (<nova.image.glance.GlanceImageService object at 0x446f390>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a'),
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_max_mem': 8388608L,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_mem': 8388608L,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_t': 22530000000L,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'base': {'checksum': '76c16ce652fed5c3665294b10e79c270',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'container_format': 'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'created_at': datetime.datetime(2012, 4, 30, 0, 48, 2),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'deleted': False,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'deleted_at': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'disk_format': 'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'id': 'd5a4b467-de5e-4042-8ad0-86478c205e01',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'is_public': True,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'min_disk': '0',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'min_ram': '0',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'name': 'Ubuntu 12.04 LTS (Precise) amd64 UEC',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'properties': {},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'size': 226623488,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'status': 'active',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'updated_at': datetime.datetime(2012, 4, 30, 0, 48, 38)},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'context': <nova.rpc.amqp.RpcContext object at 0x3f4bb50>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'disk_path': '/var/lib/nova/instances/instance-000020e2/disk',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'domain': <Element 'domain' at 0x3a377d0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_file': <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_format': 'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_href': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'd5a4b467-de5e-4042-8ad0-86478c205e01',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_service': <nova.image.glance.GlanceImageService object at 0x49e6a90>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance': <nova.db.sqlalchemy.models.Instance object at 0x446fe90>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'metadata': {'container_format': 'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'disk_format': 'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'is_public': False,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'name': 'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'properties': {'image_location': 'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_state': 'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'ramdisk_id': u''},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'status': 'active'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'out_path': '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <nova.virt.libvirt.connection.LibvirtConnection object at 0x238fdd0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'snapshot': {'checksum': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'container_format': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'created_at': datetime.datetime(2012, 8, 29, 7, 23, 11),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'deleted': False,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'deleted_at': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'disk_format': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'id': 'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'is_public': False,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'min_disk': '0',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'min_ram': '0',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'name': 'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'properties': {'image_type': 'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'instance_uuid': '2fb5ba40-0f61-4360-bb57-f28871f7cebf',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'user_id': '25'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'size': 0,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'status': 'queued',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'updated_at': datetime.datetime(2012, 8, 29, 7, 23, 11)},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'snapshot_image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'snapshot_image_service': <nova.image.glance.GlanceImageService object at 0x446f390>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'snapshot_name': 'c9950d1ac5674d66b9bbb8179baf53d3',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'source': <Element 'source' at 0x3a02550>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'source_format': 'qcow2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'state': 1,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'tmpdir': '/tmp/tmp2WBWt8',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'virt_dom': <libvirt.virDomain instance at 0x4139c20>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'xml_desc': "<domain type='kvm' id='31'>\n <name>instance-000020e2</name>\n <uuid>2fb5ba40-0f61-4360-bb57-f28871f7cebf</uuid>\n <memory>8388608</memory>\n <currentMemory>8388608</currentMemory>\n <vcpu>2</vcpu>\n <os>\n <type arch='x86_64' machine='pc-1.0'>hvm</type>\n <boot dev='hd'/>\n </os>\n <features>\n <acpi/>\n </features>\n <clock offset='utc'/>\n <on_poweroff>destroy</on_poweroff>\n <on_reboot>restart</on_reboot>\n <on_crash>destroy</on_crash>\n <devices>\n <emulator>/usr/bin/kvm</emulator>\n <disk type='file' device='disk'>\n <driver name='qemu' type='qcow2' cache='none'/>\n <source file='/var/lib/nova/instances/instance-000020e2/disk'/>\n <target dev='vda' bus='virtio'/>\n <alias name='virtio-disk0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>\n </disk>\n <disk type='file' device='disk'>\n <driver name='qemu' type='qcow2' cache='none'/>\n <source file='/var/lib/nova/instances/instance-000020e2/disk.local'/>\n <target dev='vdb' bus='virtio'/>\n <alias name='virtio-disk1'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>\n </disk>\n <interface type='bridge'>\n <mac address='fa:16:3e:17:52:ce'/>\n <source bridge='br100'/>\n <target dev='vnet7'/>\n <filterref filter='nova-instance-instance-000020e2-fa163e1752ce'>\n <parameter name='DHCPSERVER' value='115.146.92.9'/>\n <parameter name='IP' value='115.146.94.228'/>\n </filterref>\n <alias name='net0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>\n </interface>\n <serial type='file'>\n <source path='/var/lib/nova/instances/instance-000020e2/console.log'/>\n <target port='0'/>\n <alias name='serial0'/>\n </serial>\n <serial type='pty'>\n <source path='/dev/pts/8'/>\n <target port='1'/>\n <alias name='serial1'/>\n </serial>\n <console type='file'>\n <source path='/var/lib/nova/instances/instance-000020e2/console.log'/>\n <target type='serial' port='0'/>\n <alias name='serial0'/>\n </console>\n <input type='tablet' bus='usb'>\n <alias name='input0'/>\n </input>\n <input type='mouse' bus='ps2'/>\n <graphics type='vnc' port='5907' autoport='yes' listen='0.0.0.0' keymap='en-us'>\n <listen type='address' address='0.0.0.0'/>\n </graphics>\n <video>\n <model type='cirrus' vram='9216' heads='1'/>\n <alias name='video0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>\n </video>\n <memballoon model='virtio'>\n <alias name='balloon0'/>\n <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>\n </memballoon>\n </devices>\n <seclabel type='dynamic' model='apparmor' relabel='yes'>\n <label>libvirt-2fb5ba40-0f61-4360-bb57-f28871f7cebf</label>\n <imagelabel>libvirt-2fb5ba40-0f61-4360-bb57-f28871f7cebf</imagelabel>\n </seclabel>\n</domain>\n"}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 306, in update
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'client': <glance.client.V1Client object at 0x4657e10>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'context': <nova.rpc.amqp.RpcContext object at 0x3f4bb50>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'data': <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_meta': {'container_format': 'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'disk_format': 'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'is_public': False,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'name': 'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'properties': {'image_location': 'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_state': 'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'ramdisk_id': u''},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'status': 'active'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <nova.image.glance.GlanceImageService object at 0x49e6a90>}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/nova/image/glance.py", line 304, in update
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'client': <glance.client.V1Client object at 0x4657e10>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'context': <nova.rpc.amqp.RpcContext object at 0x3f4bb50>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'data': <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_meta': {'container_format': 'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'disk_format': 'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'is_public': False,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'name': 'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'properties': {'image_location': 'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_state': 'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'ramdisk_id': u''},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'status': 'active'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <nova.image.glance.GlanceImageService object at 0x49e6a90>}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/glance/client.py", line 195, in update_image
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'body': <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'features': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'headers': {'content-length': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'content-type': 'application/octet-stream',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-auth-token': u'ee51bea27ba04f44ac61e6ea279a55a4',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-container_format': u'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-disk_format': u'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-is_public': u'False',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-name': u'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_location': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_state': u'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-ramdisk_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-size': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-status': u'active'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_data': <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_id': u'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_meta': {'container_format': 'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'disk_format': 'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'is_public': False,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'name': 'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'properties': {'image_location': 'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_state': 'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'ramdisk_id': u''},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'status': 'active'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'image_size': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <glance.client.V1Client object at 0x4657e10>}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 58, in wrapped
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'args': ('PUT',
2012-08-29 07:33:08 TRACE nova.rpc.amqp u'/images/e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp {'content-length': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'content-type': 'application/octet-stream',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-auth-token': u'ee51bea27ba04f44ac61e6ea279a55a4',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-container_format': u'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-disk_format': u'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-is_public': u'False',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-name': u'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_location': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_state': u'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-ramdisk_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-size': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-status': u'active'}),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'func': <function do_request at 0x1e4c410>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'kwargs': {},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <glance.client.V1Client object at 0x4657e10>}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 420, in do_request
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'action': u'/images/e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'body': <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'headers': {'content-length': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'content-type': 'application/octet-stream',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-auth-token': u'ee51bea27ba04f44ac61e6ea279a55a4',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-container_format': u'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-disk_format': u'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-is_public': u'False',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-name': u'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_location': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_state': u'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-ramdisk_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-size': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-status': u'active'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'method': 'PUT',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'params': None,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <glance.client.V1Client object at 0x4657e10>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'url': ParseResult(scheme='http', netloc='np-rcp1.melbourne.nectar.org.au:9292', path=u'/v1/images/e866c9ee-80c7-42a0-91c4-d23b9d4edd6a', params='', query=None, fragment='')}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 75, in wrapped
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'MAX_REDIRECTS': 5,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_': 0,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'body': <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'func': <function _do_request at 0x1e4c578>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'headers': {'content-length': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'content-type': 'application/octet-stream',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-auth-token': u'ee51bea27ba04f44ac61e6ea279a55a4',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-container_format': u'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-disk_format': u'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-is_public': u'False',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-name': u'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_location': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_state': u'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-ramdisk_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-size': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-status': u'active'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'method': 'PUT',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <glance.client.V1Client object at 0x4657e10>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'url': ParseResult(scheme='http', netloc='np-rcp1.melbourne.nectar.org.au:9292', path=u'/v1/images/e866c9ee-80c7-42a0-91c4-d23b9d4edd6a', params='', query=None, fragment='')}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp File "/usr/lib/python2.7/dist-packages/glance/common/client.py", line 547, in _do_request
2012-08-29 07:33:08 TRACE nova.rpc.amqp Locals:{'_chunkbody': <function _chunkbody at 0x4759de8>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_filelike': <function _filelike at 0x311b500>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_pushing': <function _pushing at 0x3e4eb90>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_retry': <function _retry at 0x3be52a8>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_sendbody': <function _sendbody at 0x4759c08>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp '_simple': <function _simple at 0x311b668>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'body': <closed file '/tmp/tmp2WBWt8/c9950d1ac5674d66b9bbb8179baf53d3', mode 'r' at 0x33dced0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'c': <httplib.HTTPConnection instance at 0x4675680>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'connection_type': <class httplib.HTTPConnection at 0x1dc5328>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'header': 'x-image-meta-name',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'headers': {'content-length': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'content-type': 'application/octet-stream',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-auth-token': u'ee51bea27ba04f44ac61e6ea279a55a4',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-container_format': u'bare',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-disk_format': u'raw',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-is_public': u'False',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-name': u'snap2012.1.2',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_location': u'snapshot',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-image_state': u'available',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-kernel_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-owner_id': u'23',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-property-ramdisk_id': u'',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-size': 10737418240,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'x-image-meta-status': u'active'},
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'iter': <generator object chunkiter at 0x4051cd0>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'method': 'PUT',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'path': u'/v1/images/e866c9ee-80c7-42a0-91c4-d23b9d4edd6a',
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'res': <httplib.HTTPResponse instance at 0x3e5a200>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'self': <glance.client.V1Client object at 0x4657e10>,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'status_code': 400,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'url': ParseResult(scheme='http', netloc='np-rcp1.melbourne.nectar.org.au:9292', path=u'/v1/images/e866c9ee-80c7-42a0-91c4-d23b9d4edd6a', params='', query=None, fragment=''),
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'use_sendfile': False,
2012-08-29 07:33:08 TRACE nova.rpc.amqp 'value': u'snap2012.1.2'}
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp Invalid: Data supplied was not valid.
2012-08-29 07:33:08 TRACE nova.rpc.amqp Details: 400 Bad Request
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp The server could not comply with the request since it is either malformed or otherwise incorrect.
2012-08-29 07:33:08 TRACE nova.rpc.amqp
2012-08-29 07:33:08 TRACE nova.rpc.amqp Error uploading image: (BackendException): Failed to add object to Swift. Got error from Swift: put_object('images', 'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a-00035', ...) failure and no ability to reset contents for reupload.
2012-08-29 07:33:08 TRACE nova.rpc.amqp
Glance:
ERROR [glance.api.v1.images] Traceback (most recent call last):
File "/usr/lib/python2.7/dist-packages/glance/api/v1/images.py", line 393, in _upload
image_size)
File "/usr/lib/python2.7/dist-packages/glance/store/swift.py", line 468, in add
raise glance.store.BackendException(msg)
BackendException: Failed to add object to Swift.
Got error from Swift: put_object('images', 'e866c9ee-80c7-42a0-91c4-d23b9d4edd6a-00035', ...) failure and no ability to reset contents for reupload.
Swift:
Aug 29 07:31:44 np-rcp1-int swift-proxy-server ERROR Client read timeout (60s) (txn: tx63d535ecc0e4436fb372548eba4117ed) (client_ip: 115.146.92.105)
Aug 29 07:31:53 np-rcp1-int swift-proxy-server 115.146.92.105 115.146.92.105 29/Aug/2012/07/31/53 PUT /v1/AUTH_3/images/e866c9ee-80c7-42a0-91c4-d23b9d4edd6a-00035 HTTP/1.0 408 - - 49c45a349eaf473aae3a1f948a2c4c5b 3342336 - - tx63d535ecc0e4436fb372548eba4117ed X-Tenant-Name%3A%20glance%0AX-Timestamp%3A%201346225444.59149%0AX-Role%3A%20Admin%0AX-User-Id%3A%2005981327e31941b28fd4ec0dfb4687a1%0AContent-Length%3A%20204800000%0AX-Auth-Token%3A%2049c45a349eaf473aae3a1f948a2c4c5b%0AX-Trans-Id%3A%20tx63d535ecc0e4436fb372548eba4117ed%0AX-Identity-Status%3A%20Confirmed%0AX-Roles%3A%20Admin%0AX-User%3A%20glance%0AHost%3A%20swift.rc.nectar.org.au%3A8888%0AX-Tenant-Id%3A%203%0AX-Tenant%3A%20glance%0AX-User-Name%3A%20glance%0AContent-Type%3A%20application/octet-stream%0AAccept-Encoding%3A%20identity 69.1460 -
To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1043148/+subscriptions
