using pipelines with a local model

Question

I am trying to use a simple pipeline offline. I am only allowed to download files directly from the web.

I went to https://huggingface.co/distilbert-base-uncased-finetuned-sst-2-english/tree/main and downloaded all the files in a local folder C:\\Users\\me\\mymodel

However, when I tried to load the model I get a strange error

from transformers import pipeline

classifier = pipeline(task= 'sentiment-analysis', 
                      model= "C:\\Users\\me\\mymodel",
                      tokenizer = "C:\\Users\\me\\mymodel")

ValueError: unable to parse C:\Users\me\mymodel\modelcard.json as a URL or as a local path

What is the issue here?

Can you list the contents of that directory?

kkgarg
– kkgarg

2021-07-26 22:56:12 +00:00
Commented Jul 26, 2021 at 22:56 — kkgarg
– kkgarg, Commented Jul 26, 2021 at 22:56

ℕʘʘḆḽḘ · Accepted Answer · 2021-07-27 19:09:06Z

2

the solution was slightly indirect:

load the model on a computer with internet access
save the model with save_pretrained()
transfer the folder obtained above to the offline machine and point its path in the pipeline call

The folder will contain all the expected files.

answered Jul 27, 2021 at 19:09

ℕʘʘḆḽḘ

19.5k39 gold badges149 silver badges259 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

desertnaut · Accepted Answer · 2024-09-28 21:31:28Z

1

Must be either of the two cases:

You didn't download all the required files properly
Folder path is wrong

FYI, I am listing out the required contents in the directory:

config.json
pytorch_model.bin/ tf_model.h5
special_tokens_map.json
tokenizer.json
tokenizer_config.json
vocab.txt

edited Sep 28, 2024 at 21:31

desertnaut

60.8k32 gold badges155 silver badges183 bronze badges

answered Jul 26, 2021 at 23:00

kkgarg

1,4161 gold badge14 silver badges36 bronze badges

2 Comments

ℕʘʘḆḽḘ Over a year ago

hello! thanks, well I simply downloaded all the files listed in the url above. Note, I am using tensor flow so its tf_model.h5 instead of pytorch_model.bin. I dont see a special token map.json for instance

kkgarg Over a year ago

Did it work finally? Not sure why you mentioned map.json, please elaborate

Collectives™ on Stack Overflow

using pipelines with a local model

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related