duplicity-team team mailing list archive

[Scott <question196423@xxxxxxxxxxxxxxxxxxxxx>]

New question #196423 on Duplicity:
https://answers.launchpad.net/duplicity/+question/196423

I'm getting duplicity setup and doing a partial test upload to my hosted webspace. I've tried several times now and am getting the same result: it works great up until partway through the 41st *.difftar.gpg file, at which point it fails with this error:

#######
INFO 1
 . Using archive dir: /home/firecat53/.cache/duplicity/1498ef4c9557164d69523e5aec4c78ce
 
 INFO 1
 . Using backup name: 1498ef4c9557164d69523e5aec4c78ce
 
 INFO 1
 . Import of duplicity.backends.sshbackend Succeeded
 
 INFO 1
 . Import of duplicity.backends.rsyncbackend Succeeded
 
 INFO 1
 . Import of duplicity.backends.botobackend Succeeded
 
 INFO 1
 . Import of duplicity.backends.webdavbackend Succeeded
 
 INFO 1
 . Import of duplicity.backends.hsibackend Succeeded
 
 INFO 1
 . Import of duplicity.backends.localbackend Succeeded
 
 INFO 1
 . Import of duplicity.backends.ftpsbackend Succeeded
 
 WARNING 1
 . Import of duplicity.backends.giobackend Failed: No module named gio
 
 INFO 1
 . Import of duplicity.backends.ftpbackend Succeeded
 
 INFO 1
 . Import of duplicity.backends.cloudfilesbackend Succeeded
 
  0 INFO 1
INFO 1
 . Import of duplicity.backends.imapbackend Succeeded
 
 INFO 1
 . Import of duplicity.backends.gdocsbackend Succeeded
 
 INFO 1
 . Main action: inc
 
 INFO 1
 . ================================================================================
 
 INFO 1
 . duplicity 0.6.18 (February 29, 2012)
 
 INFO 1
 . Args: /usr/bin/duplicity --use-agent -vdebug --encrypt-key 42A79D21 --sign-key E6C991E3 --full-if-older-than 60D --exclude /mnt/backup/bfd-training-data --exclude /mnt/backup/fsarchiver --exclude /mnt/backup/media --exclude /mnt/backup/usapparel --num-retries 25 --log-file /home/firecat53/dup.log /mnt/backup scp://user@xxxxxxxxxxxxxxx//backups/homeserver
 
 INFO 1
 . Linux homeserver 3.0.29-1-lts #1 SMP PREEMPT Mon Apr 23 09:41:11 CEST 2012 x86_64 AMD Sempron(tm) Processor 3400+
 
 INFO 1
 . /usr/bin/python2 2.7.3 (default, Apr 24 2012, 00:00:54)
 . [GCC 4.7.0 20120414 (prerelease)]
 
 INFO 1
 . ================================================================================
 
 INFO 1
 . Using temporary directory /tmp/duplicity-Hj3jqk-tempdir
DEBUG 1
 . Registering (mkstemp) temporary file /tmp/duplicity-Hj3jqk-tempdir/mkstemp-IHXNWE-1
 
 INFO 1
 . Temp has 490516480 available, backup will use approx 34078720.
 
 NOTICE 1
 . Local and Remote metadata are synchronized, no sync needed.
 
 DEBUG 1
 . 0 files exist on backend
 
 DEBUG 1
 . 0 files exist in cache
 
 DEBUG 1
 . Extracting backup chains from list of files: []
 
 NOTICE 1
 . Last full backup date: none
 
 NOTICE 1
 . Last full backup is too old, forcing full backup
 
 INFO 3
 backend SftpBackend
 archive-dir (() /home/firecat53/.cache/duplicity/1498ef4c9557164d69523e5aec4c78ce dir)
 orphaned-sets-num 0
 incomplete-sets-num 0
 . Collection Status
 . -----------------
 . Connecting with backend: SftpBackend
 . Archive dir: /home/firecat53/.cache/duplicity/1498ef4c9557164d69523e5aec4c78ce
 .
 . Found 0 secondary backup chains.
 . No backup chains with active signatures found
 . No orphaned or incomplete backup sets found.

<snip lots of code>

DEBUG 1
 . Removing still remembered temporary file /tmp/duplicity-Hj3jqk-tempdir/mkstemp-IHXNWE-1
 
 DEBUG 1
 . Removing still remembered temporary file /tmp/duplicity-Hj3jqk-tempdir/mktemp-bZzCOB-42
 
 INFO 1
 . Backend error detail: Traceback (most recent call last):
 .   File "/usr/bin/duplicity", line 1391, in <module>
 .     with_tempdir(main)
 .   File "/usr/bin/duplicity", line 1384, in with_tempdir
 .     fn()
 .   File "/usr/bin/duplicity", line 1354, in main
 .     full_backup(col_stats)
 .   File "/usr/bin/duplicity", line 500, in full_backup
 .     globals.backend)
 .   File "/usr/bin/duplicity", line 399, in write_multivol
 .     (tdp, dest_filename, vol_num)))
 .   File "/usr/lib/python2.7/site-packages/duplicity/asyncscheduler.py", line 145, in schedule_task
 .     return self.__run_synchronously(fn, params)
 .   File "/usr/lib/python2.7/site-packages/duplicity/asyncscheduler.py", line 171, in __run_synchronously
 .     ret = fn(*params)
 .   File "/usr/bin/duplicity", line 398, in <lambda>
 .     async_waiters.append(io_scheduler.schedule_task(lambda tdp, dest_filename, vol_num: put(tdp, dest_filename, vol_num)    ,
 .   File "/usr/bin/duplicity", line 296, in put
 .     backend.put(tdp, dest_filename)
 .   File "/usr/lib/python2.7/site-packages/duplicity/backends/sshbackend.py", line 191, in put
 .     raise BackendException("sftp put of %s (as %s) failed: %s" % (source_path.name,remote_filename,e))
 . BackendException: sftp put of /tmp/duplicity-Hj3jqk-tempdir/mktemp-bZzCOB-42 (as duplicity-full.20120507T221749Z.vol41.d    ifftar.gpg) failed:
 .
 
 ERROR 23 BackendException
 . BackendException: sftp put of /tmp/duplicity-Hj3jqk-tempdir/mktemp-bZzCOB-42 (as duplicity-full.20120507T221749Z.vol41.d    ifftar.gpg) failed:
######

Then if I try to restart the backup, it just sits there with no additional error messages like this until I manually kill the process with ^C:

######
Using archive dir: /home/firecat53/.cache/duplicity/1498ef4c9557164d69523e5aec4c78ce                                 [80/4613]
Using backup name: 1498ef4c9557164d69523e5aec4c78ce
Import of duplicity.backends.sshbackend Succeeded
Import of duplicity.backends.rsyncbackend Succeeded
Import of duplicity.backends.botobackend Succeeded
Import of duplicity.backends.webdavbackend Succeeded
Import of duplicity.backends.hsibackend Succeeded
Import of duplicity.backends.localbackend Succeeded
Import of duplicity.backends.ftpsbackend Succeeded
Import of duplicity.backends.giobackend Failed: No module named gio
Import of duplicity.backends.ftpbackend Succeeded
Import of duplicity.backends.cloudfilesbackend Succeeded
Import of duplicity.backends.u1backend Succeeded
Import of duplicity.backends.tahoebackend Succeeded
Import of duplicity.backends.imapbackend Succeeded
Import of duplicity.backends.gdocsbackend Succeeded
Main action: inc
================================================================================
duplicity 0.6.18 (February 29, 2012)
Args: /usr/bin/duplicity --use-agent -vdebug --encrypt-key 42A79D21 --sign-key E6C991E3 --full-if-older-than 60D --exclude /mn
t/backup/bfd-training-data --exclude /mnt/backup/fsarchiver --exclude /mnt/backup/media --exclude /mnt/backup/usapparel --num-
retries 25 --log-file /home/firecat53/dup.log /mnt/backup scp://user@xxxxxxxxxxxxxxx//backups/homeserver
Linux homeserver 3.0.29-1-lts #1 SMP PREEMPT Mon Apr 23 09:41:11 CEST 2012 x86_64 AMD Sempron(tm) Processor 3400+
/usr/bin/python2 2.7.3 (default, Apr 24 2012, 00:00:54) 
[GCC 4.7.0 20120414 (prerelease)]
================================================================================
Using temporary directory /tmp/duplicity-Frtabh-tempdir
Registering (mkstemp) temporary file /tmp/duplicity-Frtabh-tempdir/mkstemp-p79ysC-1
Temp has 490516480 available, backup will use approx 34078720.
Local and Remote metadata are synchronized, no sync needed.
41 files exist on backend
2 files exist in cache
Extracting backup chains from list of files: ['duplicity-full.20120507T221749Z.manifest.part', 'duplicity-full-signat[48/4613]
0507T221749Z.sigtar.part', 'duplicity-full.20120507T221749Z.vol1.difftar.gpg', 'duplicity-full.20120507T221749Z.vol2.difftar.g
pg', 'duplicity-full.20120507T221749Z.vol3.difftar.gpg', 'duplicity-full.20120507T221749Z.vol4.difftar.gpg', 'duplicity-full.2
0120507T221749Z.vol5.difftar.gpg', 'duplicity-full.20120507T221749Z.vol6.difftar.gpg', 'duplicity-full.20120507T221749Z.vol7.d
ifftar.gpg', 'duplicity-full.20120507T221749Z.vol8.difftar.gpg', 'duplicity-full.20120507T221749Z.vol9.difftar.gpg', 'duplicit
y-full.20120507T221749Z.vol10.difftar.gpg', 'duplicity-full.20120507T221749Z.vol11.difftar.gpg', 'duplicity-full.20120507T2217
49Z.vol12.difftar.gpg', 'duplicity-full.20120507T221749Z.vol13.difftar.gpg', 'duplicity-full.20120507T221749Z.vol14.difftar.gp
g', 'duplicity-full.20120507T221749Z.vol15.difftar.gpg', 'duplicity-full.20120507T221749Z.vol16.difftar.gpg', 'duplicity-full.
20120507T221749Z.vol17.difftar.gpg', 'duplicity-full.20120507T221749Z.vol18.difftar.gpg', 'duplicity-full.20120507T221749Z.vol
19.difftar.gpg', 'duplicity-full.20120507T221749Z.vol20.difftar.gpg', 'duplicity-full.20120507T221749Z.vol21.difftar.gpg', 'du
plicity-full.20120507T221749Z.vol22.difftar.gpg', 'duplicity-full.20120507T221749Z.vol23.difftar.gpg', 'duplicity-full.2012050
7T221749Z.vol24.difftar.gpg', 'duplicity-full.20120507T221749Z.vol25.difftar.gpg', 'duplicity-full.20120507T221749Z.vol26.diff
tar.gpg', 'duplicity-full.20120507T221749Z.vol27.difftar.gpg', 'duplicity-full.20120507T221749Z.vol28.difftar.gpg', 'duplicity
-full.20120507T221749Z.vol29.difftar.gpg', 'duplicity-full.20120507T221749Z.vol30.difftar.gpg', 'duplicity-full.20120507T22174
9Z.vol31.difftar.gpg', 'duplicity-full.20120507T221749Z.vol32.difftar.gpg', 'duplicity-full.20120507T221749Z.vol33.difftar.gpg
', 'duplicity-full.20120507T221749Z.vol34.difftar.gpg', 'duplicity-full.20120507T221749Z.vol35.difftar.gpg', 'duplicity-full.2
0120507T221749Z.vol36.difftar.gpg', 'duplicity-full.20120507T221749Z.vol37.difftar.gpg', 'duplicity-full.20120507T221749Z.vol3
8.difftar.gpg', 'duplicity-full.20120507T221749Z.vol39.difftar.gpg', 'duplicity-full.20120507T221749Z.vol40.difftar.gpg', 'dup
licity-full.20120507T221749Z.vol41.difftar.gpg']
File duplicity-full.20120507T221749Z.manifest.part is not part of a known set; creating new set
File duplicity-full-signatures.20120507T221749Z.sigtar.part is not part of a known set; creating new set
Ignoring file (rejected by backup set) 'duplicity-full-signatures.20120507T221749Z.sigtar.part'
File duplicity-full.20120507T221749Z.vol1.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol2.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol3.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol4.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol5.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol6.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol7.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol8.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol9.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol10.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol11.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol12.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol13.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol14.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol15.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol16.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol17.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol18.difftar.gpg is part of known set                                           [9/4613]
File duplicity-full.20120507T221749Z.vol19.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol20.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol21.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol22.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol23.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol24.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol25.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol26.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol27.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol28.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol29.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol30.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol31.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol32.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol33.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol34.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol35.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol36.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol37.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol38.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol39.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol40.difftar.gpg is part of known set
File duplicity-full.20120507T221749Z.vol41.difftar.gpg is part of known set
Found backup chain [Mon May  7 15:17:49 2012]-[Mon May  7 15:17:49 2012]
Last full backup left a partial set, restarting.
Last full backup date: Mon May  7 15:17:49 2012
Collection Status
-----------------
Connecting with backend: SftpBackend
Archive dir: /home/firecat53/.cache/duplicity/1498ef4c9557164d69523e5aec4c78ce

Found 0 secondary backup chains.

Found primary backup chain with matching signature chain:
-------------------------
Chain start time: Mon May  7 15:17:49 2012
Chain end time: Mon May  7 15:17:49 2012
Number of contained backup sets: 1
Total number of contained volumes: 41
 Type of backup set:                            Time:      Num volumes:
                Full         Mon May  7 15:17:49 2012                41
-------------------------
No orphaned or incomplete backup sets found.
RESTART: Volumes 41 to 41 failed to upload before termination.
         Restarting backup at volume 41.
Registering (mktemp) temporary file /tmp/duplicity-Frtabh-tempdir/mktemp-eAT8P1-2
^C
#########

Any ideas? 

Thanks!
Scott


-- 
You received this question notification because you are a member of
duplicity-team, which is an answer contact for Duplicity.