Model2Vec

[yhfwww]

If a model like Model2Vec is used, how is the embedding of documents specifically implemented? Is it not necessary to pay attention to the length of the document as is the case with the general bert model?

[MaartenGr]

Yes and no. It should work with any length of document but just remember that when you have extremely long documents, the embeddings get averaged and may average out some important information.