Cannot receive request on LMStudio Server from Docker Container Application?

Question

I am trying to self host Khoj AI and I have followed all the steps in the documentation.

The only thing I changed in yml file is:-

- OPENAI_API_BASE=http://localhost:1234/v1/

That is where my LMStudio is running on the host machine. And when I do a call from my host machine like:-

curl http://localhost:1234/v1/models/

I get a response so server is up and running. But when I try to send the same request from Khoj AI GUI frontend, The server does not show any incoming requests. Which means that Docker Container app cannot access the server on host machine. How can I make the LMStudio server on host machine available to my Khoj AI docker terminal?

I have checked this and this but I do not understand them.

Mr. · Accepted Answer · 2025-01-20 15:38:35Z

0

by design, the guest (containers, in your case - khoj ai) is unable to access the host services (in your case - lmstudio), which is expected behavior since containers are isolated by default.

you have a few options:

run lmstudio in a container and configure khoj ai appropriately
mount lmstudio socket file into the khoj ai container and use the socket file to interact with lmstudio. see the second example in "Connect to it from a second container"
use a special hostname host.docker.internal to refer to the host machine from inside a the khoj ai container
run the khoj ai container in a network mode that allows it to connect to the host with the --network host flag

edited Jan 20 at 15:38

answered Jan 20 at 15:33

Mr.

10.2k14 gold badges67 silver badges93 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Cannot receive request on LMStudio Server from Docker Container Application?

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related