Skip to content
This repository has been archived by the owner on Jan 1, 2025. It is now read-only.

Is there any way to generate heatmap with ToMe #14

Open
Nightwatch-Fox11 opened this issue Dec 8, 2022 · 0 comments
Open

Is there any way to generate heatmap with ToMe #14

Nightwatch-Fox11 opened this issue Dec 8, 2022 · 0 comments

Comments

@Nightwatch-Fox11
Copy link

Hello,
Thanks for this amazing work!

I'm wondering if you've tried generating heatmap of the attention weight before, like Grad-CAM. For example, after I get the attention weight of each attention block and the corresponding source matrix, is there any way to generate heatmap with ToMe like the following image:
image

Looking forward to your reply :)

Best

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant