Using AWS Sagemaker for model performance without creating endpoint

Question

I've been using Amazon Sagemaker Notebooks to build a pytorch model for an NLP task. I know you can use Sagemaker to train, deploy, hyper parameter tuning, and model monitoring.

However, it looks like you have to create an inference endpoint in order to monitor the model's inference performance.

I already have a EC2 instance setup to perform inference tasks on our model, which is currently on a development box and rather not use an endpoint to make

Is it possible to use Sagemaker to train, run hyperparam tuning and model eval without creating an endpoint.

Andre · Accepted Answer · 2020-10-29 23:01:49Z

2

If you don't want to keep an inference endpoint up, one option is to use SageMaker Processing to run a job that takes your trained model and test dataset as input, performs inference and computes evaluation metrics, and saves them to S3 in a JSON file.

This Jupyter notebook example steps through (1) preprocessing training and test data, (2) training a model, then (3) evaluating the model

answered Oct 29, 2020 at 23:01

Andre

5684 silver badges17 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Using AWS Sagemaker for model performance without creating endpoint

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related