If you have a GPU it is possible for chatd to use it to speed up the chat response time. Currently only NVIDIA GPUs are supported.
- NVIDIA GPU with CUDA support
- Linux (Windows support is planned)
- Download Ollama for Linux:
curl https://ollama.ai/install.sh | sh
- After installing Ollama, chatd will automatically use your GPU to speed up chat response time. You can verify that chatd is connected to Ollama by checking for the
ollama is running
message on the home screen.