Does not work with local models

[GeroinEXP]

Uploaded two models.
Deepseek and Qwen2.5
Doesn't want to work with them

[cyberpsilosis]

same here

[warmshao]

Uncheck Use Tool Calls in Content and Use vision, setting Max Actions per Step=1. That works for me to use qwen2.5:7b, but the result is poor, try bigger model

[cyberpsilosis]

I'm trying to use deepseek:7b , as it seems competent enough for basic tasks.

It simply won't appear in the ollama llm drop down list in the web ui. Is there any guide on setting up local llms with this webui? The ollama server is running and I can chat with the llm in the terminal but it's not being seen by the web ui

[imonedesign]

You need to write the model name manually in "Model Name", the drop-down menu is also a text input.

[kevinrodriguez-io]

In my case I get tons of Error: received prediction-error even with ngrok setup to forward my lm studio server.

[cyberpsilosis]

@imonedesign I tried that. Has it worked for you?

[imonedesign]

@imonedesign I tried that. Has it worked for you?

Yes but the model took forever on the first step of the prompt so I had to switch to OpenAi API for now

[dhierholzer]

Trying to use local model with ollama (hf.co/unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF:Q4_K_M)

Get the following error:

File "/home/dan/web-ui/webui.py", line 352, in run_custom_agent
agent = CustomAgent(
^^^^^^^^^^^^
File "/home/dan/web-ui/src/agent/custom_agent.py", line 92, in init
if self.llm.model_name in ["deepseek-reasoner"]:
^^^^^^^^^^^^^^^^^^^
File "/home/dan/miniconda3/envs/browseruse/lib/python3.12/site-packages/pydantic/main.py", line 891, in getattr
raise AttributeError(f'{type(self).name!r} object has no attribute {item!r}')
AttributeError: 'ChatOllama' object has no attribute 'model_name'. Did you mean: 'model_dump'?
Traceback (most recent call last):

Any suggestions?

Thanks

[giokevin]

@dhierholzer i solved by manually remove that if statement

[pathanjalisrinivasan]

Trying to use local model with ollama (hf.co/unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF:Q4_K_M)

Get the following error:

File "/home/dan/web-ui/webui.py", line 352, in run_custom_agent agent = CustomAgent( ^^^^^^^^^^^^ File "/home/dan/web-ui/src/agent/custom_agent.py", line 92, in init if self.llm.model_name in ["deepseek-reasoner"]: ^^^^^^^^^^^^^^^^^^^ File "/home/dan/miniconda3/envs/browseruse/lib/python3.12/site-packages/pydantic/main.py", line 891, in getattr raise AttributeError(f'{type(self).name!r} object has no attribute {item!r}') AttributeError: 'ChatOllama' object has no attribute 'model_name'. Did you mean: 'model_dump'? Traceback (most recent call last):

Any suggestions?

Thanks

Has anyone solved this error? Trying to run Deepseel-r1:latest (locally using Ollama) and it keeps throwing this error. I have unchecked both vision & Tool Calls in Content

[vvincent1234]

Trying to use local model with ollama (hf.co/unsloth/DeepSeek-R1-Distill-Llama-70B-GGUF:Q4_K_M)
Get the following error:
File "/home/dan/web-ui/webui.py", line 352, in run_custom_agent agent = CustomAgent( ^^^^^^^^^^^^ File "/home/dan/web-ui/src/agent/custom_agent.py", line 92, in init if self.llm.model_name in ["deepseek-reasoner"]: ^^^^^^^^^^^^^^^^^^^ File "/home/dan/miniconda3/envs/browseruse/lib/python3.12/site-packages/pydantic/main.py", line 891, in getattr raise AttributeError(f'{type(self).name!r} object has no attribute {item!r}') AttributeError: 'ChatOllama' object has no attribute 'model_name'. Did you mean: 'model_dump'? Traceback (most recent call last):
Any suggestions?
Thanks

Has anyone solved this error? Trying to run Deepseel-r1:latest (locally using Ollama) and it keeps throwing this error. I have unchecked both vision & Tool Calls in Content

update codes please