Relative Filepathing within Jupyter Imported Function

Question

I have a basic yet annoying file reading issue.

I have a repo set up like this:

/repo/functions/feature.py
               /script.sql

/repo/notebooks/task.ipynb

Within feature.py, I have a function that reads the script.sql and modifies it based off some input. Importing this function into a notebook within the /functions directory works just fine.

However, when I have a notebook task.ipynb in a different directory /notebooks, the function now gives a "File not found" error. If I move the .sql file to /notebooks then it works again, but this is far from ideal. I have also considered consolidating all static files into one directory, but this is annoying.

Is there a way to correctly route the file path lookup to always occur within the place it is inputted, regardless of where the function itself is imported and called?

spatzlsberger · Accepted Answer · 2021-01-11 19:04:14Z

2

This is what you want: stackoverflow thread.

You can use the __file__ keyword within feature.py to access the directory where feature.py is. You can then build a path to script.sql reliably if it is always in the same directory as feature.py.

answered Jan 11, 2021 at 19:04

spatzlsberger

1066 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

AZhao · Accepted Answer · 2021-01-11 19:18:40Z

0

I'll give an answer award to spatzlsberger, as he did point me the right way to How to make an "always relative to current module" file path?

This answer worked out for me. Leverage pathlib and modify the filepaths like so.

from pathlib import Path

here = Path(__file__).parent
fname = here/'script.sql'

answered Jan 11, 2021 at 19:18

AZhao

14.5k8 gold badges33 silver badges55 bronze badges

Collectives™ on Stack Overflow

Relative Filepathing within Jupyter Imported Function

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related