duplicity-team team mailing list archive

Thread
Date

[Question #193846]: These backup times seem very excessive

To: duplicity-team@xxxxxxxxxxxxxxxxxxx
From: Chris Stankaitis <question193846@xxxxxxxxxxxxxxxxxxxxx>
Date: Mon, 16 Apr 2012 19:30:49 -0000
Reply-to: question193846@xxxxxxxxxxxxxxxxxxxxx
Sender: bounces@xxxxxxxxxxxxx

New question #193846 on Duplicity:
https://answers.launchpad.net/duplicity/+question/193846

I am backing up files from one RAID array to a 2nd (local disk)  I.E. from /dev/sdb to /dev/sdc  and I am seeing very excessive backup times.  This is causing me to be unable to run daily incremental backups.

Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Tue Apr  3 13:43:15 2012
--------------[ Backup Statistics ]--------------
StartTime 1334198004.29 (Wed Apr 11 22:33:24 2012)
EndTime 1334504987.98 (Sun Apr 15 11:49:47 2012)
ElapsedTime 306983.69 (85 hours 16 minutes 23.69 seconds)
SourceFiles 203
SourceFileSize 314257699705 (293 GB)
NewFiles 6
NewFileSize 24576 (24.0 KB)
DeletedFiles 0
ChangedFiles 40
ChangedFileSize 239824252920 (223 GB)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 46
RawDeltaSize 28361373902 (26.4 GB)
TotalDestinationSizeChange 19308097435 (18.0 GB)
Errors 0
-------------------------------------------------

and 

Local and Remote metadata are synchronized, no sync needed.
Last full backup date: Tue Apr  3 19:29:54 2012
--------------[ Backup Statistics ]--------------
StartTime 1334506498.81 (Sun Apr 15 12:14:58 2012)
EndTime 1334548211.79 (Sun Apr 15 23:50:11 2012)
ElapsedTime 41712.98 (11 hours 35 minutes 12.98 seconds)
SourceFiles 1047
SourceFileSize 211338608127 (197 GB)
NewFiles 8
NewFileSize 73728 (72.0 KB)
DeletedFiles 0
ChangedFiles 381
ChangedFileSize 208686327292 (194 GB)
ChangedDeltaSize 0 (0 bytes)
DeltaEntries 389
RawDeltaSize 17216688797 (16.0 GB)
TotalDestinationSizeChange 3215297671 (2.99 GB)
Errors 0
-------------------------------------------------

What if anything can I do to speed this up?  

The --asynchronous-upload flag as been marked as experimental for about as long as I have been using duplicity (3 years or so) is this still very risky? has the code been fixed and the docs not updated to reflect?  what are the risks to using this flag?

Running on

RHEL6 x86_64
duplicity 0.6.17


-- 
You received this question notification because you are a member of
duplicity-team, which is an answer contact for Duplicity.