python: alter setup.py to search local file system directory for required dependencies

Question

My project depends on lots of packages. Some are listed on pypi, some are not.

I now have a folder named "external-packages" where I keep .tar.gz files of the packages that I need that are not on pypi.

I want to alter setup.py so that when it reads the install_requires section and finds a package that is not yet installed, first, it should look in the "external-packages" folder, and then if that fails, then it should go search on pypi.

Is this possible? How to do this?

Thanks for the help.

Have you tried adding external-packages to your PYTHONPATH? — Rajesh J Advani
– Rajesh J Advani, Commented Aug 22, 2012 at 15:24
I have not tried that. The files in external-packages are .tar.gz files of source code. — W. Matthew Wilson
– W. Matthew Wilson, Commented Aug 22, 2012 at 17:05

jfs · Accepted Answer · 2012-08-22 18:02:32Z

1

It seems you use setuptools/distribute (indicated by install_requires option). You could use dependency_links setting in setup.py but it limits your options to distribute your package. For example, you might use one set of dependencies for development, several sets for testing, yet another set for a debian package, etc.

Both easy_install, pip install provide --find-links, --index options that you could specify at the command-line, in config files. It allows to use the right set of requirements for each specific case without editing setup.py.

You could also use requirements files to specify what versions should be installed and where to get them.

answered Aug 22, 2012 at 18:02

jfs

417k210 gold badges1k silver badges1.7k bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

W. Matthew Wilson Over a year ago

So, if I write a requirements.txt file, I should probably remove the install_requires section from setup.py, right?

jfs Over a year ago

@W.MatthewWilson: no/yes. It depends on your use case e.g., if your users should be able pip install your_package then non-vendorized dependencies that are available on pypi could be specified in install_requires. To install development environment you could: pip install -r requirements/dev.txt; pip install --no-deps -e .. Your CI server could: pip install -r requirements/test-py2.4.txt. A rpm-package might use python setup.py build without installed setuptools and ignore both install_requires and requirements files.

Collectives™ on Stack Overflow

python: alter setup.py to search local file system directory for required dependencies

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related