-
Notifications
You must be signed in to change notification settings - Fork 164
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
How to retrieve salience of some specific words? #105
Comments
From my understanding this is not possible unless you do algorithmic optimization (some math). Salience maps is doing backprop from output to embedding. This process is just chain rule, and if you break it you do get specific words, but unless mathematically grounded, your approach fails. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Hi. To obtain the salience map of previous tokens when generating new tokens, we can use the code/function provided in the example code:
However, in this standard method, I can only get the salience map for the (randomly/uncontrollable) generated word.
Is it possible to obtain the salience map for specific word? For example, in the sentence "I have a dog. He is very ...", I'd like to get the salience map for a specific word cute, rather than other words generated by the model.
Thanks very much!
The text was updated successfully, but these errors were encountered: