Skip to content

Issues: dmatora/LLM-inference-speed-benchmarks

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort

Issues list

Llama 3.1 8B Q4_K_M NVIDIA RTX 3080
#12 opened Aug 26, 2024 by ariya
llama3 8b Q6 RTX 4090 llama.cpp
#10 opened May 27, 2024 by jggc
Meta Llama 3 Instruct 70B 2xP40
#9 opened May 8, 2024 by dmatora
Mistral Instruct 7B Q4 M1 Ultra
#8 opened May 3, 2024 by dmatora
ProTip! no:milestone will show everything without a milestone.