← Back to team overview

duplicity-team team mailing list archive

Re: [Question #631423]: Too many open files (again)

 

Question #631423 on Duplicity changed:
https://answers.launchpad.net/duplicity/+question/631423

edso proposed the following answer:
On 05.05.2017 20:13, Howard Kaye wrote:
> New question #631423 on Duplicity:
> https://answers.launchpad.net/duplicity/+question/631423
> 
> In testing a full restore, I am seeing an exception get raised for "Too many open files" from within Path.open:
> 
> I am running on macOS 10.12.4, duplicity 0.7.10
> 
> I have raised the ulimit for the number of files up to 12000.  
> lsof shows there are only 89 open files
> sample shows a number of threads blocked on subprocesses (gpg processes)
> sysctl -a shows:
>   kern.maxfiles: 24576
>   kern.maxfilesperproc: 10240
>   kern.num_files: 5356
> 
> There are currently only 17 incrementals following my latest full.  We usually do monthly fulls.
> 
> Is anyone else seeing this recently?
> 

there's going to be a fix in 0.7.13, replacing the use of os.system('cp ...') with the native python routine, which should reduce the open files count dramatically
  http://duplicity.nongnu.org/CHANGELOG

it's explained in more detail here
  https://bugs.launchpad.net/duplicity/+bug/1684312

..ede/duply.net

-- 
You received this question notification because your team duplicity-team
is an answer contact for Duplicity.


References