Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

how can i use ollama models in openui #87

Open
zhjygit opened this issue May 7, 2024 · 5 comments
Open

how can i use ollama models in openui #87

zhjygit opened this issue May 7, 2024 · 5 comments

Comments

@zhjygit
Copy link

zhjygit commented May 7, 2024

my openui is in ubuntu18 vmware workstation like 192.168.1.169,my ollama and models is in physical host like 192.168.1.103. how can i use ollama models in openui of vmware workstation.

@zhjygit
Copy link
Author

zhjygit commented May 7, 2024

Finally, i download my openui and ollama on the physical host like 192.168.1.103,my ollama is running fine at 11434, i have pull llama3、llava models. i don't use docker in the whole process.
image
As above shown, i can run the openui, however, i have no open_api_key,i don't known how to pass the key to the OPEN_API_KEY, as to the ollama, where is the OPEN_API_KEY?
Whether does the openui support local models OPEN_API_KEY?

I have oneapi or open-webui in the vmware host like 192.168.1.169, maybe i can pass a api-key from oneapi,but how can i pass the host 192.168.1.169 of oneapi host to the openui?

@vanpelt
Copy link
Contributor

vanpelt commented May 8, 2024

No need for an API key. Just set OLLAMA_HOST and choose a model from the settings pane.

@Some1OnLine
Copy link

I do not have an OpenAI API Key but do have my own ollama instance. If I remove the OPENAI_API_KEY var and set OLLAMA_HOST var to my ollama URL, the container fails to start, complaining about not having the openai_api_key var set or something.

@zhjygit
Copy link
Author

zhjygit commented May 9, 2024

No need for an API key. Just set OLLAMA_HOST and choose a model from the settings pane.

no no no, i don't use openui docker, just run the openui docker locally.
If i do not set openai_api_key, python -m openui will not run with error like :openaierror,the api_key client option must be set either by passing api_key to the client or by setting the OPENAI_API_KEY environment variable.

@ethanmorton
Copy link

I don't know if you have solved your problem already, but it seems similar to this issue. The solution worked for me.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants