Skip to content

Commit

Permalink
510
Browse files Browse the repository at this point in the history
  • Loading branch information
Houssem Dellai committed Sep 20, 2024
1 parent 4f2a59f commit b1f39fa
Showing 1 changed file with 2 additions and 0 deletions.
2 changes: 2 additions & 0 deletions 510_ai_ollama_k8s/Readme.md
Original file line number Diff line number Diff line change
Expand Up @@ -94,6 +94,8 @@ Here are some example models that can be used in `ollama` [available here](https
## Important notes

- The `ollama` server is running only on CPU. However, it can also run on GPU or also NPU.
- As LLM models size are large, it is recommended to use a VM with large disk space.
- During the inference, the model will consume a lot of memory and CPU. It is recommended to use a VM with a large memory and CPU.

## References

Expand Down

0 comments on commit b1f39fa

Please sign in to comment.