Skip to content

Commit

Permalink
Add performance statistics monitor
Browse files Browse the repository at this point in the history
Signed-off-by: Xiaodong Ye <[email protected]>
  • Loading branch information
yeahdongcn committed Jan 31, 2024
1 parent f91d6ec commit b0680ca
Show file tree
Hide file tree
Showing 7 changed files with 1,063 additions and 1 deletion.
7 changes: 7 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -1,2 +1,9 @@
ollama.pid
bin/

# SPM
performance-statistics/.build/
performance-statistics/Package.resolved

# VSCode
.vscode/
7 changes: 7 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -20,6 +20,7 @@ graph LR;
subgraph Host
subgraph CLI
B(Mods)
G(Collector)
end
subgraph Server
C(Ollama)
Expand All @@ -29,13 +30,17 @@ graph LR;
subgraph Container
E(LiteLLM Proxy)
F(Ollama Web UI)
H(Prometheus)
I(Grafana)
end
A(User) --> |Terminal|B;
A --> |Browser|F;
B --> |OpenAI API|E;
E --> |REST API|C;
F --> |REST API|C;
C-. Link .-> D;
H --> |Client API|G;
I --> |Data Source|H;
```

## Quickstart
Expand All @@ -50,3 +55,5 @@ $ ./stop.sh
### Demo

![633462](https://github.com/yeahdongcn/OllamaStack/assets/2831050/1290b08a-6636-493e-8ad4-edcb18971198)

<img width="1277" alt="Screenshot 2024-01-31 at 11 45 31" src="https://github.com/yeahdongcn/OllamaStack/assets/2831050/3370513b-8920-4ee1-bc7c-0f2e4c4e8c40">
Loading

0 comments on commit b0680ca

Please sign in to comment.