New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

是否支持batch推理? #21

Open

longrunling opened this issue Nov 13, 2024 · 1 comment

longrunling commented Nov 13, 2024

您好！请问您的工作是否支持batch推理？

Owner

Hzzone commented Nov 14, 2024

可以的。提特征这一步，然后提proposal这一步都可以batch，分类这一步你要把所有Prompt和我做数据的时候一样打包。你可以把notebook塞到gpt，应该也能写出来。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment