← Back to team overview

duplicity-team team mailing list archive

Re: [Question #631423]: Too many open files (again)

 

Question #631423 on Duplicity changed:
https://answers.launchpad.net/duplicity/+question/631423

    Status: Answered => Open

Howard Kaye is still having a problem:
Actually, it is generating errors.  Still working.

On Thu, May 11, 2017 at 5:18 AM, edso <question631423@xxxxxxxxxxxxxxxxxxxxx>
wrote:

> Your question #631423 on Duplicity changed:
> https://answers.launchpad.net/duplicity/+question/631423
>
>     Status: Open => Answered
>
> edso proposed the following answer:
> Howie, i don't see the attachment?! ..ede/duply.net
>
> On 10.05.2017 22:57, Howard Kaye wrote:
> > Question #631423 on Duplicity changed:
> > https://answers.launchpad.net/duplicity/+question/631423
> >
> > Howard Kaye gave more information on the question:
> > The attached patch seems to fix the problem and keeps current behavior
> with
> > respect to temp directories.
> >
> > Howie
> >
> >
> > On Tue, May 9, 2017 at 5:08 PM, edso <question631423@answers.
> launchpad.net>
> > wrote:
> >
> >> Your question #631423 on Duplicity changed:
> >> https://answers.launchpad.net/duplicity/+question/631423
> >>
> >> edso proposed the following answer:
> >> hey guys,
> >>
> >> that looks wrong. using os.tmpfile() may resolve the issue, but it
> >> removes the users control, where the temp files are created. this comes
> >> up on list list regularly when user's small temp partitions overflow and
> >> they ask why duplicity is not respecting their temp dir setting.
> >>
> >> the python docs say
> >>
> >> https://docs.python.org/2/library/os.html#os.tmpfile
> >> "
> >> ... will be automatically deleted once there are no file descriptors for
> >> the file.
> >> "
> >> https://docs.python.org/2/library/tempfile.html#tempfile.TemporaryFile
> >> "
> >> ... It will be destroyed as soon as it is closed (including an implicit
> >> close when the object is garbage collected). ...
> >> "
> >>
> >> Howard, could you please test if explicitly closing obsolete
> >> TemporaryFiles instead in patchdir.py solves the issue as well?
> >>
> >> the whole condition looks fishy anyway. it's tempfile modules job to
> >> take care of crossplatform compatibility, no need for us to treat some
> >> platforms different than others. ..ede/duply.net
> >>
> >> On 09.05.2017 21:03, Howard Kaye wrote:
> >>> Question #631423 on Duplicity changed:
> >>> https://answers.launchpad.net/duplicity/+question/631423
> >>>
> >>>     Status: Needs information => Open
> >>>
> >>> Howard Kaye gave more information on the question:
> >>> The problem seems to be something going on in the tempfile Python
> >> library.
> >>> The following 1 line patch fixes the issue.
> >>>
> >>> *** /Users/howie/duplicity-0.7.10/duplicity/patchdir.py 2015-09-10
> >>> 09:03:43.000000000 -0400
> >>> --- patchdir.py 2017-05-09 14:27:38.000000000 -0400
> >>> ***************
> >>> *** 496,502 ****
> >>>               See https://bugs.launchpad.net/duplicity/+bug/670891 for
> >>> discussion
> >>>               of os.tmpfile() vs tempfile.TemporaryFile() w.r.t.
> Windows
> >> /
> >>> Linux.
> >>>               """
> >>> !             if sys.platform.startswith(('cygwin', 'windows')):
> >>>                   tempfp = os.tmpfile()
> >>>               else:
> >>>                   tempfp =
> >>> tempfile.TemporaryFile(dir=tempdir.default().dir())
> >>> --- 496,502 ----
> >>>               See https://bugs.launchpad.net/duplicity/+bug/670891 for
> >>> discussion
> >>>               of os.tmpfile() vs tempfile.TemporaryFile() w.r.t.
> Windows
> >> /
> >>> Linux.
> >>>               """
> >>> !             if sys.platform.startswith(('cygwin', 'windows',
> >> 'darwin')):
> >>>                   tempfp = os.tmpfile()
> >>>               else:
> >>>                   tempfp =
> >>> tempfile.TemporaryFile(dir=tempdir.default().dir())
> >>>
> >>>
> >>> On Tue, May 9, 2017 at 11:47 AM, Kenneth Loafman <
> >>> question631423@xxxxxxxxxxxxxxxxxxxxx> wrote:
> >>>
> >>>> Your question #631423 on Duplicity changed:
> >>>> https://answers.launchpad.net/duplicity/+question/631423
> >>>>
> >>>>     Status: Open => Needs information
> >>>>
> >>>> Kenneth Loafman requested more information:
> >>>> Part of the problem is the number of gpg processes, you should have a
> >>>> max of 2 or 3, not 13.  When you installed the current version, was
> >>>> there perhaps an older version on the system, maybe from ports or
> >>>> homebrew?  If so, did you uninstall that version?  The repo versions
> >>>> have different paths than the tarball version.
> >>>>
> >>>> To double check, run "locate GnuPGInterface.py".  If you have it, you
> >>>> probably have a very old duplicity hanging out there and will need to
> >>>> uninstall and purge it.
> >>>>
> >>>> --
> >>>> To answer this request for more information, you can either reply to
> >>>> this email or enter your reply at the following page:
> >>>> https://answers.launchpad.net/duplicity/+question/631423
> >>>>
> >>>> You received this question notification because you asked the
> question.
> >>>>
> >>>
> >>
> >> --
> >> If this answers your question, please go to the following page to let us
> >> know that it is solved:
> >> https://answers.launchpad.net/duplicity/+question/631423/+
> >> confirm?answer_id=15
> >>
> >> If you still need help, you can reply to this email or go to the
> >> following page to enter your feedback:
> >> https://answers.launchpad.net/duplicity/+question/631423
> >>
> >> You received this question notification because you asked the question.
> >>
> >
>
> --
> If this answers your question, please go to the following page to let us
> know that it is solved:
> https://answers.launchpad.net/duplicity/+question/631423/+
> confirm?answer_id=19
>
> If you still need help, you can reply to this email or go to the
> following page to enter your feedback:
> https://answers.launchpad.net/duplicity/+question/631423
>
> You received this question notification because you asked the question.
>

-- 
You received this question notification because your team duplicity-team
is an answer contact for Duplicity.