Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Would love the option to see more hardware stats #48

Open
subwitcher opened this issue Oct 5, 2024 · 3 comments
Open

Would love the option to see more hardware stats #48

subwitcher opened this issue Oct 5, 2024 · 3 comments

Comments

@subwitcher
Copy link

No description provided.

@a-ghorbani
Copy link
Owner

What stats do you have in mind?

@Slug-Cat
Copy link

Slug-Cat commented Dec 4, 2024

I don't know what the OP had in mind but it might be nice if the app showed current RAM usage or even estimates of what model/context sizes can run comfortably on the user device based on available memory and model size.

@bi4key
Copy link

bi4key commented Dec 8, 2024

I don't know what the OP had in mind but it might be nice if the app showed current RAM usage or even estimates of what model/context sizes can run comfortably on the user device based on available memory and model size.

Here is a simple solution, not ideal but some stat you will see. App PerfMon-Plus:
https://github.com/libxzr/PerfMon-Plus

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants