This repository was archived by the owner on Jan 1, 2025. It is now read-only.
This repository was archived by the owner on Jan 1, 2025. It is now read-only.
Is there any way to generate heatmap with ToMe #14
Description
Hello,
Thanks for this amazing work!
I'm wondering if you've tried generating heatmap of the attention weight before, like Grad-CAM. For example, after I get the attention weight of each attention block and the corresponding source matrix, is there any way to generate heatmap with ToMe like the following image:
Looking forward to your reply :)
Best