Python script fails to run using a Cronjob but executes from browser

Question

The python file begins to get executed but them, error I get is -

Time : 2018-12-26 13:00:01.751099 Traceback (most recent call last):

File "/home/username/public_html/cgi-bin/pull.py", line 13, in <module>
   df = pd.read_csv('Datasets/MC_Master.csv')
File "/home/username/.local/lib/python3.5/site- 
packages/pandas/io/parsers.py", line 678, in parser_f
  return _read(filepath_or_buffer, kwds)

File "/home/username/.local/lib/python3.5/site- 
packages/pandas/io/parsers.py", line 440, in _read
parser = TextFileReader(filepath_or_buffer, **kwds)

File "/home/username/.local/lib/python3.5/site-packages/pandas/io/parsers.py", line 787, in __init__
self._make_engine(self.engine)

File "/home/username/.local/lib/python3.5/site-packages/pandas/io/parsers.py", line 1014, in _make_engine
self._engine = CParserWrapper(self.f, **self.options)

File "/home/username/.local/lib/python3.5/site-packages/pandas/io/parsers.py", line 1708, in __init__
self._reader = parsers.TextReader(src, **kwds)

File "pandas/_libs/parsers.pyx", line 384, in pandas._libs.parsers.TextReader.__cinit__

File "pandas/_libs/parsers.pyx", line 695, in pandas._libs.parsers.TextReader._setup_parser_source

**FileNotFoundError: File b'Datasets/MC_Master.csv' does not exist**

The file MC_Master.csv is contained within cgi-bin/Datasets

PS: it works perfectly using shebang command $ python3 pull.py while i am in the cgi-bin directory.

Any guidance would be appreciated.

Gaurav · Accepted Answer · 2018-12-26 08:49:22Z

2

You must use absolute path for the dataset. Try changing Dataset/file.csv to /cgi-bin/Dataset/file.csv or whatever the absolute path is.

answered Dec 26, 2018 at 8:49

Gaurav

5435 silver badges20 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Manish Rathee Over a year ago

Thanks, it worked! Much appreciated. As suggested, I have used absolute path.

Manish Rathee Over a year ago

What should be the file permissions for cronjob execution?

arryph · Accepted Answer · 2018-12-26 08:53:31Z

1

This is because you are using relative path in your script, when you are working from cgi-bin directory, the relative paths are working fine but while running with cron, a program is executed with user's home directory as working directory. To overcome this problem, as @Gaurav mentioned, use absolute path in scripts, or just change current working directory within the program using os.chdir('/path/to/cgi-bin') before accessing the files.

answered Dec 26, 2018 at 8:53

arryph

2,84512 silver badges17 bronze badges

1 Comment

bruno desthuilliers Over a year ago

do NOT use os.chdir() - this is brittle at best -, use absolute path.

Collectives™ on Stack Overflow

Python script fails to run using a Cronjob but executes from browser

2 Answers 2

2 Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related