-
Notifications
You must be signed in to change notification settings - Fork 17
Incompatibility with transformers v5 #42
Copy link
Copy link
Open
Description
Hello,
When trying to use the encode_queries function of Splade, I got the error:
AttributeError: BertTokenizer has no attribute batch_encode_plus. Did you mean: '_encode_plus'?
I was using the v5 of the transformers library. The error disappears when switching to transformer v4. From what I understood, in transformers v5, tokenizers use a single encode function and batch_encode_plus is not a thing anymore.
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
No labels