There was an error processing your request: Custom error: Failed after 3 attempts. Last error: Internal Server Error #1178

loki-smip · 2025-01-26T09:17:18Z

Describe the bug

There was an error processing your request: Custom error: Failed after 3 attempts. Last error: Internal Server Error
im useing ollama with deepseek-r1:latest in Ubuntu and im geting this

DEBUG api.chat Total message length: 2, words
INFO LLMManager Getting dynamic models for Ollama
INFO LLMManager Got 3 dynamic models for Ollama
INFO stream-text Sending llm call to Ollama with model qwen2.5-coder:latest
DEBUG Ollama Base Url used: http://127.0.0.1:11434
ERROR api.chat AI_RetryError: Failed after 3 attempts. Last error: Internal Server Error
DEBUG api.chat Total message length: 2, words
INFO LLMManager Found 3 cached models for Ollama
INFO stream-text Sending llm call to Ollama with model qwen2.5-coder:latest
DEBUG Ollama Base Url used: http://127.0.0.1:11434
ERROR api.chat AI_RetryError: Failed after 3 attempts. Last error: Internal Server Error
ERROR LLMManager Error getting dynamic models Hyperbolic : Missing Api Key configuration for Hyperbolic provider
INFO LLMManager Caching 3 dynamic models for Ollama
Error: No baseUrl found for OLLAMA provider
at OllamaProvider.getDynamicModels (/home/loki/Downloads/bolt.diy-0.0.6/app/lib/modules/llm/providers/ollama.ts:58:13)
at loader (/home/loki/Downloads/bolt.diy-0.0.6/app/routes/api.models.ts:66:26)
at Object.callRouteLoader (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:59:22)
at handler (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected][email protected]/node_modules/@remix-run/server-runtime/dist/routes.js:54:39)
at actualHandler (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4887:14)
at /home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4901:13
at runHandler (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4906:6)
at callLoaderOrAction (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4963:22)
at Object.resolve (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4814:11)
at map (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4772:62)
at Array.map ()
at dataStrategyImpl (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4772:49)
at callDataStrategyImpl (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4835:23)
at callDataStrategy (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:3992:25)
at loadRouteData (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:3937:25)
at queryImpl (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:3696:26)
at Object.queryRoute (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:3629:24)
at handleResourceRequest (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:402:40)
at requestHandler (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:24)
at /home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run+dev@2.15.0_@remix-run [email protected][email protected]_react@[email protected]_typ_3djlhh3t6jbfog2cydlrvgreoy/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:31
at processTicksAndRejections (node:internal/process/task_queues:95:5)
ERROR LLMManager Error getting dynamic models Hyperbolic : Missing Api Key configuration for Hyperbolic provider
DEBUG api.chat Total message length: 2, words
INFO LLMManager Getting dynamic models for Ollama
INFO LLMManager Got 3 dynamic models for Ollama
INFO stream-text Sending llm call to Ollama with model deepseek-r1:latest
DEBUG Ollama Base Url used: http://127.0.0.1:11434
ERROR api.chat AI_RetryError: Failed after 3 attempts. Last error: Internal Server Error
Error: No baseUrl found for OLLAMA provider
at OllamaProvider.getDynamicModels (/home/loki/Downloads/bolt.diy-0.0.6/app/lib/modules/llm/providers/ollama.ts:58:13)
at loader (/home/loki/Downloads/bolt.diy-0.0.6/app/routes/api.models.ts:66:26)
at Object.callRouteLoader (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected][email protected]/node_modules/@remix-run/server-runtime/dist/data.js:59:22)
at handler (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected][email protected]/node_modules/@remix-run/server-runtime/dist/routes.js:54:39)
at actualHandler (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4887:14)
at /home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4901:13
at runHandler (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4906:6)
at callLoaderOrAction (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4963:22)
at Object.resolve (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4814:11)
at map (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4772:62)
at Array.map ()
at dataStrategyImpl (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4772:49)
at callDataStrategyImpl (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:4835:23)
at callDataStrategy (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:3992:25)
at loadRouteData (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:3937:25)
at queryImpl (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:3696:26)
at Object.queryRoute (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected]/node_modules/@remix-run/router/router.ts:3629:24)
at handleResourceRequest (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:402:40)
at requestHandler (/home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run [email protected][email protected]/node_modules/@remix-run/server-runtime/dist/server.js:156:24)
at /home/loki/Downloads/bolt.diy-0.0.6/node_modules/.pnpm/@remix-run+dev@2.15.0_@remix-run [email protected][email protected]_react@[email protected]_typ_3djlhh3t6jbfog2cydlrvgreoy/node_modules/@remix-run/dev/dist/vite/cloudflare-proxy-plugin.js:70:31
at processTicksAndRejections (node:internal/process/task_queues:95:5)
DEBUG api.chat Total message length: 2, words
INFO LLMManager Getting dynamic models for Ollama
INFO LLMManager Got 3 dynamic models for Ollama
INFO stream-text Sending llm call to Ollama with model deepseek-r1:latest
DEBUG Ollama Base Url used: http://127.0.0.1:11434
ERROR api.chat AI_RetryError: Failed after 3 attempts. Last error: Internal Server Error
ERROR LLMManager Error getting dynamic models Hyperbolic : Missing Api Key configuration for Hyperbolic provider
INFO LLMManager Caching 3 dynamic models for Ollama

Screen Recording / Screenshot

and in term

Platform

OS: ,Linux Ubuntu
Browser: [e.g. Chrome, Safari, Firefox]
Version: [e.g. 91.1]

Ranger-Dj · 2025-01-26T09:35:26Z

same issue

iiinvent · 2025-01-26T09:39:37Z

I think there is one more pointer missing the stack somewhere something that is not there yet, but it will come back in a couple of weeks. Want me to come over and look at it but I won’t minds if you come over and fetch me some thing tomorrow Get Outlook for iOS<https://aka.ms/o0ukef>

…

________________________________ From: RangerDj ***@***.***> Sent: Sunday, January 26, 2025 11:36:06 AM To: stackblitz-labs/bolt.diy ***@***.***> Cc: Subscribed ***@***.***> Subject: Re: [stackblitz-labs/bolt.diy] There was an error processing your request: Custom error: Failed after 3 attempts. Last error: Internal Server Error (Issue #1178) same issue — Reply to this email directly, view it on GitHub<#1178 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/BKYHL3QNY6PZXBZLA2E3QZT2MSUANAVCNFSM6AAAAABV4HYY56VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMJUGI4TOMJSHE>. You are receiving this because you are subscribed to this thread.Message ID: ***@***.***>

kareem-g · 2025-01-26T18:12:26Z

same issue here.

leex279 · 2025-01-26T21:25:33Z

Just got problems with this very Model or with all models you try to use?

See my video on youtube. Might help. Let me know if still issues.

https://youtu.be/JItHTxqE0KQ

kareem-g · 2025-01-27T00:12:37Z

Hi, I resolved the issue by adding the following rules to the Ubuntu environment:

Open a terminal and run: sudo gedit ~/.bashrc
Add the following rules:

# OLLAMA
export OLLAMA_HOST=0.0.0.0
export OLLAMA_ORIGINS=*

Save the file.
Restart your device and try running the Bolt app again.

Additionally, make sure to add the default URL of Ollama in the .env or .env.local file like this: http://127.0.0.1:11434. The localhost:11434 URL causes an error.

Hope this helps!

mahimsafa · 2025-01-27T15:01:46Z

@kareem-g Your solution works. Thanks a lot

kareem-g · 2025-01-27T16:49:44Z

@kareem-g Your solution works. Thanks a lot

You're welcome!

do you know how to make ollama runs on GPU instead of CPU? I use Ubuntu with GTX 1650 ti 4gb

mahimsafa · 2025-01-27T16:58:35Z

@kareem-g as far as I know by default tries to run on GPU. While running you can check for the GPU usage with this command nvidia-smi to verify.

Here is the supported GPU list: https://github.com/ollama/ollama/blob/main/docs/gpu.md

kareem-g · 2025-01-27T18:03:40Z

@kareem-g as far as I know by default tries to run on GPU. While running you can check for the GPU usage with this command nvidia-smi to verify.

Here is the supported GPU list: https://github.com/ollama/ollama/blob/main/docs/gpu.md

I checked this page before, but it doesn't work it always uses the CPU. when i use small model like phi3 it uses GPU and sometimes CPU. idk why, I saw people runs on both CPU/GPU and I donnu how.

the cpu is damn slow but it works fine and I use it inside vscode but I need to use GPU for faster results.

my current CUDA Version:

nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Fri_Jan__6_16:45:21_PST_2023
Cuda compilation tools, release 12.0, V12.0.140
Build cuda_12.0.r12.0/compiler.32267302_0

kareem-g · 2025-01-27T18:15:07Z

@kareem-g as far as I know by default tries to run on GPU. While running you can check for the GPU usage with this command nvidia-smi to verify.
Here is the supported GPU list: https://github.com/ollama/ollama/blob/main/docs/gpu.md

I checked this page before, but it doesn't work it always uses the CPU. when i use small model like phi3 it uses GPU and sometimes CPU. idk why, I saw people runs on both CPU/GPU and I donnu how.

the cpu is damn slow but it works fine and I use it inside vscode but I need to use GPU for faster results.

my current CUDA Version:
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Fri_Jan__6_16:45:21_PST_2023
Cuda compilation tools, release 12.0, V12.0.140
Build cuda_12.0.r12.0/compiler.32267302_0

Lol. I was able to fix it by running this command on terminal:

nvidia-smi -L to force ollama to use GPU alongside with CPU and restarting ollama did the trick.

sudo systemctl stop ollama
sudo systemctl start ollama
sudo systemctl status ollama

I wanna thank me hehe. xD

thecodacus · 2025-01-29T13:37:23Z

I believe the issue is fixed

leex279 added the question Further information is requested label Jan 26, 2025

thecodacus closed this as completed Jan 29, 2025

thecodacus pinned this issue Jan 29, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

There was an error processing your request: Custom error: Failed after 3 attempts. Last error: Internal Server Error #1178

There was an error processing your request: Custom error: Failed after 3 attempts. Last error: Internal Server Error #1178

loki-smip commented Jan 26, 2025 •

edited

Loading

Ranger-Dj commented Jan 26, 2025

iiinvent commented Jan 26, 2025 via email

kareem-g commented Jan 26, 2025

leex279 commented Jan 26, 2025

kareem-g commented Jan 27, 2025

mahimsafa commented Jan 27, 2025 •

edited

Loading

kareem-g commented Jan 27, 2025

mahimsafa commented Jan 27, 2025

kareem-g commented Jan 27, 2025

kareem-g commented Jan 27, 2025

thecodacus commented Jan 29, 2025

There was an error processing your request: Custom error: Failed after 3 attempts. Last error: Internal Server Error #1178

There was an error processing your request: Custom error: Failed after 3 attempts. Last error: Internal Server Error #1178

Comments

loki-smip commented Jan 26, 2025 • edited Loading

Describe the bug

Screen Recording / Screenshot

Platform

Ranger-Dj commented Jan 26, 2025

iiinvent commented Jan 26, 2025 via email

kareem-g commented Jan 26, 2025

leex279 commented Jan 26, 2025

kareem-g commented Jan 27, 2025

mahimsafa commented Jan 27, 2025 • edited Loading

kareem-g commented Jan 27, 2025

mahimsafa commented Jan 27, 2025

kareem-g commented Jan 27, 2025

kareem-g commented Jan 27, 2025

thecodacus commented Jan 29, 2025

loki-smip commented Jan 26, 2025 •

edited

Loading

mahimsafa commented Jan 27, 2025 •

edited

Loading