← Back to team overview

duplicity-team team mailing list archive

Re: [Question #658653]: Cannot allocate memory with large manifest file

 

Question #658653 on Duplicity changed:
https://answers.launchpad.net/duplicity/+question/658653

    Status: Open => Answered

edso proposed the following answer:
Siva,

also these tickets might be of help

https://answers.launchpad.net/duplicity/+question/270906
https://bugs.launchpad.net/bugs/1684312
https://bugs.launchpad.net/bugs/896728

long story short. start a new backup chain. limit the amount of
files/data so that, as memory usage grows with backup size/chain length.

..ede/duply.net

On 26.09.2017 09:15, Sivanath wrote:
> Question #658653 on Duplicity changed:
> https://answers.launchpad.net/duplicity/+question/658653
> 
> Description changed to:
> Hi team
> 
> I have used the duplicity for backup my server files from few months
> before.  And It was working fine. Currently I have upgraded the
> duplicity new version(0.7.14),  after upgraded the backup manifest cache
> file written in large size(near to GBs) due to bulk delete or changes in
> files.
> 
> It was stopped the next backup process with this error - "OSError:
> [Errno 12] Cannot allocate memory".
> 
> Please help me on this. Is there any way to solve this problem?
> 
> Herewith  I have placed the logged error information for your reference.
> 
> Traceback (most recent call last):
>   File "/usr/bin/duplicity", line 1548, in <module>
>     with_tempdir(main)
>   File "/usr/bin/duplicity", line 1534, in with_tempdir
>     fn()
>   File "/usr/bin/duplicity", line 1383, in main
>     do_backup(action)
>   File "/usr/bin/duplicity", line 1515, in do_backup
>     check_last_manifest(col_stats)  # not needed for full backup
>   File "/usr/bin/duplicity", line 1217, in check_last_manifest
>     last_backup_set.check_manifests()
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/collections.py", line 208, in check_manifests
>     remote_manifest = self.get_remote_manifest()
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/collections.py", line 241, in get_remote_manifest
>     manifest_buffer = self.backend.get_data(self.remote_manifest_name)
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line 677, in get_data
>     fin = self.get_fileobj_read(filename, parseresults)
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/backend.py", line 671, in get_fileobj_read
>     return tdp.filtered_open_with_delete("rb")
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/dup_temp.py", line 120, in filtered_open_with_delete
>     fh = FileobjHooked(path.DupPath.filtered_open(self, mode))
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/path.py", line 779, in filtered_open
>     return gpg.GPGFile(False, self, gpg_profile)
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/gpg.py", line 217, in __init__
>     'logger': self.logger_fp})
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/gpginterface.py", line 374, in run
>     create_fhs, attach_fhs)
>   File "/usr/local/lib/python2.7/dist-packages/duplicity/gpginterface.py", line 414, in _attach_fork_exec
>     process.pid = os.fork()
> OSError: [Errno 12] Cannot allocate memory
>

-- 
You received this question notification because your team duplicity-team
is an answer contact for Duplicity.