Import error on installed package using setup.py

Question

I have a problem with using setup.py to setup a python package. First, I have the following directory setup:

maindir
   |- setup.py
   |-mymodule
         |- __init__.py
         |- mainmodule.py
         |-subdir
             |- __init__.py
             |- submodule.py

i.e. the project directory contains the setup.py and a directory mymodule, which in itself contains two python modules in two directories. The file submodule.py contains just

teststring = "hello world"

mainmodule.py contains:

from .subdir import submodule
mainstring = "42"

and setup.py contains:

import os
from setuptools import setup
setup(
    name = "mytestmodule",
    version = "0.0.1",
    description = ("A simple module."),
    packages=['mymodule'],
)

When I do from mymodule import mainmodule with ipython from within sourceTest the behaviour works as expected and I can reference e.g. mainmodule.submodule.teststring which gives me the string hello world.

On the other side, when I install this 'package' using python setup.py install and try to do the same (from within some other directory), I get an import error:

In [1]: from mymodule import mainmodule
---------------------------------------------------------------------------
ImportError                               Traceback (most recent call last)
/home/alexander/<ipython-input-1-cf4c9bafa487> in <module>()
----> 1 from mymodule import mainmodule

/home/alexander/build/bdist.linux-i686/egg/mymodule/mainmodule.py in <module>()

ImportError: No module named subdir

I do not see what I have done wrong, as I followed a Getting started tutorial and rules for importing intra-packages. I suppose my mistake is a really tiny one, but I cannot spot it and help is appreciated.

Pavel Anossov · Accepted Answer · 2013-03-12 17:40:20Z

55

You have to list all packages in setup, including subpackages:

setup(
    name = "mytestmodule",
    version = "0.0.1",
    description = ("A simple module."),
    packages=['mymodule', 'mymodule.subdir'],
)

Or you can use setuptools's magic function find_packages:

from setuptools import setup, find_packages
setup(
    name = "mytestmodule",
    version = "0.0.1",
    description = ("A simple module."),
    packages=find_packages(),
)

This is mentioned here:

If you have sub-packages, they must be explicitly listed in packages, but any entries in package_dir automatically extend to sub-packages. (In other words, the Distutils does not scan your source tree, trying to figure out which directories correspond to Python packages by looking for __init__.py files.)

edited Mar 12, 2013 at 17:40

answered Mar 12, 2013 at 17:32

Pavel Anossov

63.3k16 gold badges156 silver badges125 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Alex Over a year ago

Is this described somewhere? Is there some documentation on the content of setup on distutils? It does not seem easy to find representative documentation.

0 _ Over a year ago

For further reference that elaborates on how package_dir is used recursively to find sub-packages, provided that those sub-packages are listed in packages, read this.

Shubham Chaudhary · Accepted Answer · 2015-05-10 18:17:54Z

6

You need to specify your each modules explicitly. Instead of maintaining the complexity of adding module to setup.py everytime, you may use the find_packages method from setuptools.

find_packages takes two optional arguments:

where which is default to '.' i.e your curdir.
exclude list of stuff to exclude

I usually have tests in my repo, so I use:

from setuptools import find_packages

packages=find_packages(exclude=["*.tests", "*.tests.*", "tests.*", "tests"]),

answered May 10, 2015 at 18:17

Shubham Chaudhary

51.6k9 gold badges84 silver badges81 bronze badges

Comments

ThorSummoner · Accepted Answer · 2017-12-19 01:04:32Z

0

I had scriptname.py:main in my setup.py console_scripts, the .py is redundant.

answered Dec 19, 2017 at 1:04

ThorSummoner

18.6k18 gold badges144 silver badges156 bronze badges

Collectives™ on Stack Overflow

Import error on installed package using setup.py

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

2 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related