Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Hi ! i have a question about Reprogramming Interpretation #132

Open
Jeong-Eul opened this issue Aug 13, 2024 · 1 comment
Open

Hi ! i have a question about Reprogramming Interpretation #132

Jeong-Eul opened this issue Aug 13, 2024 · 1 comment

Comments

@Jeong-Eul
Copy link

How did you obtain the word set, and how did you create a visualization that shows how closely it is related to each prototype?

In the code, vocabulary is used by taking the weight of the LLM's embedding layer, but I thought it would be difficult to interpret which word combination prototype and which time series patch had the high attention score.

Thank you for reading my question.

@diaosilei
Copy link

How did you obtain the word set, and how did you create a visualization that shows how closely it is related to each prototype?

In the code, vocabulary is used by taking the weight of the LLM's embedding layer, but I thought it would be difficult to interpret which word combination prototype and which time series patch had the high attention score.

Thank you for reading my question.

Hi, there. I got the same confusion when I read their paper. Do you find some cues to solve this question?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants