Skip to content

Calling word embeddings "models" is a bit misleading. #17

Open
@xuf12

Description

Thanks for putting this together! However, the embedding vectors are just the weights from a shallow NN, which offers far less info than a complete language model (just like the weights from the first layer of training ResNet and ResNet itself). I think we may want to change the title so it doesn't mislead people into believing a word vector is a model...

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions