← Back to team overview

duplicity-team team mailing list archive

Re: [Question #253609]: Amazone S3 Connection Reset by peer

 

It bothers me that you have both a .gpg and a .part file of the same
basename in the cache.  Hang on to both if possible.

You will need to transfer the manifest file to S3 as well to make a
complete backup.  Then you will need to check S3 to make sure that all the
volume files made it.  S3 is notorious for reporting success when in fact
there was none.

Could you post the command line used to make the backup so I know what
purpose .part played.

On Fri, Oct 17, 2014 at 1:31 PM, Northrock <
question253609@xxxxxxxxxxxxxxxxxxxxx> wrote:

> Question #253609 on Duplicity changed:
> https://answers.launchpad.net/duplicity/+question/253609
>
> Northrock posted a new comment:
> It looks like S3 may support uploads >5GB via multipart
> http://docs.aws.amazon.com/cli/latest/reference/s3api/create-multipart-
> upload.html
>
> A hint I found that boto perhaps supports it too now
> https://github.com/boto/boto/issues/729
>
> For TODAY, I'm hoping I will be able to transfer this 20GB+ sig file to
> S3 manually (I've started that process already).  Assuming I can do it
> manually via AWS CLI utility, could you help me understand how to
> complete the final "commit" so I'm not guessing / missing something
> important; I was left with these three files in the cache directory:
>
> duplicity-full.20141011T024928Z.manifest.part (736416)
> duplicity-full-signatures.20141011T024928Z.sigtar.gpg (21287868023)
> duplicity-full-signatures.20141011T024928Z.sigtar.part (27911208960)
>
> e.g. rename .part files / what's the difference between .part and .gpg,
> is there a way i can see the final stats on this job (total files/size)
>
> I'm very impressed that duplicity et al proved to be robust enough to
> get us to this point.  Any help to get this first large full backup
> committed so we can continue with smaller incrementals forward would be
> most appreciated.
>
> --
> You received this question notification because you are a member of
> duplicity-team, which is an answer contact for Duplicity.
>
> _______________________________________________
> Mailing list: https://launchpad.net/~duplicity-team
> Post to     : duplicity-team@xxxxxxxxxxxxxxxxxxx
> Unsubscribe : https://launchpad.net/~duplicity-team
> More help   : https://help.launchpad.net/ListHelp
>

Follow ups

References