You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A derived instance of [`CandidateGenerator`] that defines how candidate sequences are generated. For
4429
-
more information, the documentation of [`CandidateGenerator`] should be read.
4429
+
more information, the documentation of [`CandidateGenerator`] should be read. Only one of `assistant_model` or `candidate_generator` should be passed as input to this function.
4430
4430
assistant_model (`PreTrainedModel`, *optional*):
4431
4431
An assistant model that can be used to accelerate generation. The assistant model must have the exact
4432
4432
same tokenizer. The acceleration is achieved when forecasting candidate tokens with the assistent model
0 commit comments