Installing modules inside python .py file

Question

I am deploying a custom pytorch model on AWS sagemaker, Following this tutorial. In my case I have few dependencies to install some modules.

I need pycocotools in my inference.py script. I can easily install pycocotool inside a separate notebook using this bash command,

%%bash

pip -g install pycocotools

But when I create my endpoint for deployment, I get this error that pycocotools in not defined. I need pycocotools inside my inference.py script. How I can install this inside a .py file

How about running a shell script in the beginning of the code inside inference.py where it runs pip install? — Dr. Regex
– Dr. Regex, Commented Apr 20, 2021 at 21:29

Dr. Regex · Accepted Answer · 2021-05-01 15:29:31Z

1

At the beginning of inference.py add these lines:

from subprocess import check_call, run, CalledProcessError
import sys
import os

# Since it is likely that you're going to run inference.py multiple times, this avoids reinstalling the same package:
if not os.environ.get("INSTALL_SUCCESS"):
    
    try:
        check_call(
        [ sys.executable, "pip", "install", "pycocotools",]
        )
    except CalledProcessError:
        run(
        ["pip", "install", "pycocotools",]
        )
    os.environ["INSTALL_SUCCESS"] = "True"

edited May 1, 2021 at 15:29

answered Apr 21, 2021 at 0:31

Dr. Regex

1663 silver badges7 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Irfan Umar Over a year ago

I get this error, "OriginalMessage": "Command '['/opt/conda/bin/python3.6', 'pip', 'install', 'pycocotools']' returned non-zero exit status. Please note, it may work in simple scnerio, but I am using it in deploying sagemaker endpoint and testing it on Postman app

Irfan Umar Over a year ago

This worked for me anyhow. Thanks! import subprocess list_files = subprocess.run(["pip", "install", "pycocotools"])

Collectives™ on Stack Overflow

Installing modules inside python .py file

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related