Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

显存大小有要求? #75

Open
huakang402 opened this issue Nov 25, 2024 · 1 comment
Open

显存大小有要求? #75

huakang402 opened this issue Nov 25, 2024 · 1 comment

Comments

@huakang402
Copy link

请问 v2 版本中使用local方法 对GPU显存大小有要求吗?至少需要多大显存能满足需求呢

@junyangwang0410
Copy link
Collaborator

预期需要12G。不过也可以使用Qwen-VL2最新的小参数模型,显存会进一步降低

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants