Llama70b评估速度过慢
#472
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
{{ message }}
-
Llama70b评估速度过慢，一个数据集几乎要三四个小时才能完成，请问有加速的办法吗，可以使用vllm加速吗？
Beta Was this translation helpful? Give feedback.
All reactions