New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Poolformer 速度问题跟踪 #151

Open

Ldpe2G opened this issue Feb 18, 2022 · 0 comments

Assignees

Labels

bug

Collaborator

Ldpe2G commented Feb 18, 2022

Groupnorm是速度瓶颈

在测速时，发现与pytorch相比速度过慢

绕过Groupnorm之后，速度提升几十倍，可以证明是groupnorm的问题

需要做得精细一点，即使Group Norm被绕过但还是慢了一点，可以profile看看具体哪里慢了，可以和白夏颖交流。

意思就是你不用关心GN，在OneFlow和PyTorch都不用GN的情况下寻找一下为什么OneFlow还是慢一点，参考：https://github.com/Oneflow-Inc/OneTeam/issues/1020

Ldpe2G added the bug label

Ldpe2G assigned thinksoso, rentainhe, Ldpe2G and BBuf

rentainhe changed the title ~~Poolformer 速度问题~~ Poolformer 速度问题跟踪

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment