Skip to content

Commit

Permalink
[from_pretrained] imporve the error message when _no_split_modules
Browse files Browse the repository at this point in the history
…is not defined (#23861)

* Better warning

* Update src/transformers/modeling_utils.py

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>

* format line

---------

Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
  • Loading branch information
ArthurZucker and sgugger authored May 30, 2023
1 parent 58022e4 commit af2aac5
Showing 1 changed file with 4 additions and 1 deletion.
5 changes: 4 additions & 1 deletion src/transformers/modeling_utils.py
Original file line number Diff line number Diff line change
Expand Up @@ -2734,7 +2734,10 @@ def from_pretrained(cls, pretrained_model_name_or_path: Optional[Union[str, os.P
target_dtype = torch.int8

if model._no_split_modules is None:
raise ValueError(f"{model.__class__.__name__} does not support `device_map='{device_map}'` yet.")
raise ValueError(
f"{model.__class__.__name__} does not support `device_map='{device_map}'`. To implement support, the model"
"class needs to implement the `_no_split_modules` attribute."
)
no_split_modules = model._no_split_modules
if device_map not in ["auto", "balanced", "balanced_low_0", "sequential"]:
raise ValueError(
Expand Down

0 comments on commit af2aac5

Please sign in to comment.