New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Question on FitNet (Hint) #7

Open

ooodragon94 opened this issue Mar 2, 2021 · 1 comment

ooodragon94 commented Mar 2, 2021

Thanks for your code!
From what I know, fitnet uses "hints" and both KD loss
seems like KDCriterion only use module as criterion

is there something I might be missing? thanks!

qianhuiliu commented Apr 28, 2023

I have the same question. Have you figured it out? Do you know how to train the "hints" ? Thx

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment