openstack team mailing list archive

[Sharif Islam <islamsh@xxxxxxxxxxx>]

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Anyone tested swift with large files (> 200GB)?


I tried to upload a 130GB file: using segments:

 -S 4147483648 newcontainer file130G.tmp
file130G.tmp segment 1
file130G.tmp segment 9
file130G.tmp segment 3
file130G.tmp segment 6
file130G.tmp segment 8
file130G.tmp segment 4
file130G.tmp segment 0
file130G.tmp segment 5
file130G.tmp segment 2
file130G.tmp segment 7
file130G.tmp segment 13
file130G.tmp segment 12
file130G.tmp segment 14
file130G.tmp segment 16
file130G.tmp segment 17
file130G.tmp segment 20
file130G.tmp segment 19
file130G.tmp segment 15 [after 2 attempts]
file130G.tmp segment 22
file130G.tmp segment 23
file130G.tmp segment 21
file130G.tmp segment 10 [after 3 attempts]

saw these errors;


Nov  2 15:51:25 b002 proxy-server ERROR with Account server
172.29.202.13:6002/sda3 re: Trying to get account info for /AUTH_system:
ConnectionTimeout (0.5s) (client_ip: xxx.xx.xx.xxx)
Nov  2 15:51:42 b002 object-replicator Starting object replication pass.
Nov  2 15:51:42 b002 object-replicator Nothing replicated for
0.000977993011475 seconds.
Nov  2 15:51:42 b002 object-replicator Object replication complete.
(0.00 minutes)
Nov  2 15:51:49 b002 container-replicator Beginning replication run
Nov  2 15:51:49 b002 container-replicator Replication run OVER
Nov  2 15:51:49 b002 container-replicator Attempted to replicate 0 dbs
in 0.00071 seconds (0.00000/s)
Nov  2 15:51:49 b002 container-replicator Removed 0 dbs
Nov  2 15:51:49 b002 container-replicator 0 successes, 0 failures
Nov  2 15:51:49 b002 container-replicator no_change:0 ts_repl:0 diff:0
rsync:0 hashmatch:0 empty:0
Nov  2 15:51:50 b002 account-replicator Beginning replication run
Nov  2 15:51:50 b002 account-replicator Replication run OVER
Nov  2 15:51:50 b002 account-replicator Attempted to replicate 0 dbs in
0.00102 seconds (0.00000/s)
Nov  2 15:51:50 b002 account-replicator Removed 0 dbs
Nov  2 15:51:50 b002 account-replicator 0 successes, 0 failures
Nov  2 15:51:50 b002 account-replicator no_change:0 ts_repl:0 diff:0
705.0363
Nov  2 15:52:08 b002 proxy-server ERROR with Object server
172.29.202.14:6000/sda3 re: Expect: 100-continue on
/AUTH_system/newcontainer_segments/file130G.tmp/1320261131.87/139527716864/00000031:
ConnectionTimeout (0.5s)

- --sharif


- -- 
Sharif Islam
Senior Systems Analyst/Programmer
FutureGrid (http://futuregrid.org)
Pervasive Technology Institute, Indiana University Bloomington
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.10 (GNU/Linux)
Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/

iQEcBAEBAgAGBQJOsaAwAAoJEACffes9SivFAWMIAIuB7MP/b2vDjewU9BelEV16
Mvwzum9wCt/BVrJEliWhCwNr+3uxcyPsGICQEgNGG6YyU8hOxXWFaWB/O546PzBx
gQulFRjG20wYw91yIm3NVvVyZrmVyRlYgcsQckcB4gjmMfdfIQ7PKlRtRP4mZ5by
/a83HU3GIfwlU0HIHQC9umAozKq5OtDcXS7aEgj7u8uYBgVLAL0kJ5YsRNMAv68d
Ve87J0oGCl9s0EGGFSkECaXf1Iln8AfF1UePd62ku5X2tWK9CvVVyaKlaRPF5nhC
Lvu3JO96FZUb9j2r/NKVv3LKGRhpYbKnpDJtzF1Eq6ojDi+KwzuvJOMnRf6ZD6Y=
=2ciw
-----END PGP SIGNATURE-----