Questions in paper #11
Description
I found that the value of attention to oneself in the attention figure is 0, that is, the value of the diagonal part is 0, which means that one cannot attend to oneself. Will this affect performance? Is there any experimental verification? Thanks.