Skip to content

deprecated reference tokenizer.max_len in glue.py (PR #10220) #10372

Closed
@poedator

Description

@poedator

There is a deprecated reference to tokenizer.max_len with tokenizer.model_max_length - similar to issue 8739 and PR 8604.
See error example in Colab here. it causes AttributeError: 'BertTokenizer' object has no attribute 'max_len'
The error happens when glue_convert_examples_to_features() is called without max_length parameter specified. In that case line 119 with wrong reference gets called.

I submitted a simple PR #10220. It should be able to fix this issue.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions