Are these embeddings Contextualized Embeddings ?

[jbdatascience]

Are these embeddings Contextualized Embeddings ?

Contextualized Embeddings are embeddings such as in Transformers.
Contextualized Embeddings are able to generate different vector representations for the different meanings a single word can have (this is called polysemy). For example the word "bank" has a lot of different meanings (such as financial organization or the bank of a river etc. etc.). All these different menaings of "bank" get totally different vectors in Contextualized Embeddings.
In NON-Contextualized Embeddings the word bank is represented by a single vector in embedding space, which is of course a very bad representation !

Therefore my question:
Are these embeddings Contextualized Embeddings ?

[hongjin-su]

Hi, Thanks a lot for your interest in the INSTRUCTOR!

I guess we need to provide context in order to get contextualized embeddings. For example, if we are only provided with a single word "bank", I think it is hard to guess the meaning it refers to.