yahoo-eng-team team mailing list archive

[Jamie Lennox <jamielennox@xxxxxxxxxx>]

Public bug reported:

So every time i tried to run tox i was getting the error message that
/tmp was out of space when trying to create the virtual env which means
that creating the virtualenv was filling a 3gb partition.

In our tox requirements we currently have:

deps = -r{toxinidir}/requirements.txt
       -r{toxinidir}/test-requirements.txt
       .[ldap]
       .[memcache]
       .[mongodb]

By having each of those additional dependencies listed as .[XXX] tox is
installing . (the keystone working directory) into a virtualenv then
determining the entry point. This created 3 seperate /tmp/pip-XXX-build
directories. The other side of this is that my keystone/.testrepository
folder is now 994M so when tox copied this to tmp 3 times and then tried
to install all the dependencies it doesn't leave much space.

There are two fixes to this: 
1. reset my .testrepository database
2. dependencies should be listed together like .[XXX,YYY,ZZZ] so . is only copied once

As an addition to this because we are installing dependencies with
.[XXX] which means install . (working directory/keystone) + XXX
dependencies there is no reason to specifically install -r
requirements.txt as this will be handled for us.

** Affects: keystone
     Importance: Undecided
     Assignee: Jamie Lennox (jamielennox)
         Status: In Progress

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Keystone.
https://bugs.launchpad.net/bugs/1490354

Title:
  Tox exhausting /tmp partition

Status in Keystone:
  In Progress

Bug description:
  So every time i tried to run tox i was getting the error message that
  /tmp was out of space when trying to create the virtual env which
  means that creating the virtualenv was filling a 3gb partition.

  In our tox requirements we currently have:

  deps = -r{toxinidir}/requirements.txt
         -r{toxinidir}/test-requirements.txt
         .[ldap]
         .[memcache]
         .[mongodb]

  By having each of those additional dependencies listed as .[XXX] tox
  is installing . (the keystone working directory) into a virtualenv
  then determining the entry point. This created 3 seperate /tmp/pip-
  XXX-build directories. The other side of this is that my
  keystone/.testrepository folder is now 994M so when tox copied this to
  tmp 3 times and then tried to install all the dependencies it doesn't
  leave much space.

  There are two fixes to this: 
  1. reset my .testrepository database
  2. dependencies should be listed together like .[XXX,YYY,ZZZ] so . is only copied once

  As an addition to this because we are installing dependencies with
  .[XXX] which means install . (working directory/keystone) + XXX
  dependencies there is no reason to specifically install -r
  requirements.txt as this will be handled for us.

To manage notifications about this bug go to:
https://bugs.launchpad.net/keystone/+bug/1490354/+subscriptions