Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

推理bmodel数据格式转换 #63

Open
Dawsonqw opened this issue Dec 12, 2024 · 0 comments
Open

推理bmodel数据格式转换 #63

Dawsonqw opened this issue Dec 12, 2024 · 0 comments

Comments

@Dawsonqw
Copy link

你好,我现在是想在将一个官方未支持的模型在算能卡上进行推理,目前进展是已经将onnx网络转换成bmodel并且可以完成推理,问题是网络被转换后数据输入格式是fp16的,给定的输入是fp32,那我需要自己实现C++接口将数据从fp32转换到fp16吗,如果是有参考文档或者相关接口吗?因为目前看到的网络都是用int类型作为输入,但目前遇到的一个模型需要将fp数据作为输入。

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant