From 6aad3872ce7b3459d5f9332f022eff63fa5e4384 Mon Sep 17 00:00:00 2001 From: Yih-Dar <2521628+ydshieh@users.noreply.github.com> Date: Wed, 18 May 2022 21:26:44 +0200 Subject: [PATCH] fix (#17337) Co-authored-by: ydshieh --- src/transformers/generation_utils.py | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/src/transformers/generation_utils.py b/src/transformers/generation_utils.py index 228a7a37a26a2d..8e4bcbd7ad0883 100644 --- a/src/transformers/generation_utils.py +++ b/src/transformers/generation_utils.py @@ -942,8 +942,8 @@ def generate( If set to float < 1, only the most probable tokens with probabilities that add up to `top_p` or higher are kept for generation. typical_p (`float`, *optional*, defaults to 1.0): - The amount of probability mass from the original distribution to be considered in typical decoding. - If set to 1.0 it takes no effect. See [this paper](https://arxiv.org/pdf/2202.00666.pdf) for more details. + The amount of probability mass from the original distribution to be considered in typical decoding. If + set to 1.0 it takes no effect. See [this paper](https://arxiv.org/pdf/2202.00666.pdf) for more details. repetition_penalty (`float`, *optional*, defaults to 1.0): The parameter for repetition penalty. 1.0 means no penalty. See [this paper](https://arxiv.org/pdf/1909.05858.pdf) for more details.