Skip to content

Commit 2808cdf

Browse files
ganteArthurZucker
andcommitted
Update src/transformers/generation/utils.py
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>
1 parent be72667 commit 2808cdf

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

src/transformers/generation/utils.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -4426,7 +4426,7 @@ def assisted_decoding(
44264426
The sequence used as a prompt for the generation.
44274427
candidate_generator (`CandidateGenerator`, *optional*):
44284428
A derived instance of [`CandidateGenerator`] that defines how candidate sequences are generated. For
4429-
more information, the documentation of [`CandidateGenerator`] should be read.
4429+
more information, the documentation of [`CandidateGenerator`] should be read. Only one of `assistant_model` or `candidate_generator` should be passed as input to this function.
44304430
assistant_model (`PreTrainedModel`, *optional*):
44314431
An assistant model that can be used to accelerate generation. The assistant model must have the exact
44324432
same tokenizer. The acceleration is achieved when forecasting candidate tokens with the assistent model

0 commit comments

Comments
 (0)