Skip to content

Commit

Permalink
Added Deberta model type support (#34308)
Browse files Browse the repository at this point in the history
* Added Deberta model type for 'add_prefix_space' functionality

* housekeeping

---------

Co-authored-by: Filippos Ventirozos <filippos.ventirozos@autotrader.co.uk>
  • Loading branch information
FilipposVentirozos and Filippos Ventirozos authored Oct 23, 2024
1 parent 5ba85de commit 343c8cb
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion examples/pytorch/token-classification/run_ner.py
Original file line number Diff line number Diff line change
Expand Up @@ -366,7 +366,7 @@ def get_label_list(labels):
)

tokenizer_name_or_path = model_args.tokenizer_name if model_args.tokenizer_name else model_args.model_name_or_path
if config.model_type in {"bloom", "gpt2", "roberta"}:
if config.model_type in {"bloom", "gpt2", "roberta", "deberta"}:
tokenizer = AutoTokenizer.from_pretrained(
tokenizer_name_or_path,
cache_dir=model_args.cache_dir,
Expand Down

0 comments on commit 343c8cb

Please sign in to comment.