Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Fix diversity rate bug #1477

Merged
merged 9 commits into from
Dec 16, 2021
Merged

Fix diversity rate bug #1477

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
121eb52
update perf
smallv0221 Dec 14, 2021
3b3b9a0
Merge branch 'develop' into sub_strategy
smallv0221 Dec 14, 2021
f704334
fix doc and constrains for FasterGeneration
smallv0221 Dec 15, 2021
7816e22
update readme
smallv0221 Dec 15, 2021
7a917d9
Merge branch 'sub_strategy' of https://github.com/smallv0221/PaddleNL…
smallv0221 Dec 15, 2021
c4466a8
Merge branch 'develop' into sub_strategy
smallv0221 Dec 16, 2021
20e361c
fix diversity rate bug
smallv0221 Dec 16, 2021
c9fc7e3
Merge branch 'sub_strategy' of https://github.com/smallv0221/PaddleNL…
smallv0221 Dec 16, 2021
5cd8076
Merge branch 'develop' of https://github.com/PaddlePaddle/PaddleNLP i…
smallv0221 Dec 16, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion examples/faster/faster_generation/samples/unimo_sample.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ def postprocess_response(token_ids, tokenizer):
add_start_token_for_decoding=True,
return_tensors=True,
is_split_into_words=False)
model.eval()

outputs, _ = model.generate(
input_ids=inputs_ids['input_ids'],
token_type_ids=inputs_ids['token_type_ids'],
Expand Down
6 changes: 3 additions & 3 deletions paddlenlp/ops/faster_transformer/transformer/decoding.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1381,7 +1381,7 @@ def forward(self,
_bos_id=bos_token_id,
_eos_id=eos_token_id,
_max_out_len=max_out_len,
_diversity_rate=diversity_rate,
_diversity_rate=-diversity_rate,
_unk_id=self._unk_id,
_mask_id=self._mask_id,
_temperature=temperature,
Expand Down Expand Up @@ -1625,7 +1625,7 @@ def forward(self,
self.linear_weight, self.linear_bias, self.pos_emb,
decoding_strategy, beam_size, top_k, top_p, self._n_head,
int(self._d_model / self._n_head), self._num_decoder_layers,
bos_token_id, eos_token_id, max_out_len, diversity_rate, rel_len,
bos_token_id, eos_token_id, max_out_len, -diversity_rate, rel_len,
alpha, early_stopping)

ids = finalize(
Expand Down Expand Up @@ -1877,7 +1877,7 @@ def forward(self,
self.linear_bias, self.pos_emb, trg_word, decoding_strategy,
beam_size, top_k, top_p, self._n_head,
int(self._d_model / self._n_head), self._num_decoder_layers,
bos_token_id, eos_token_id, max_out_len, diversity_rate, rel_len,
bos_token_id, eos_token_id, max_out_len, -diversity_rate, rel_len,
alpha, temperature, early_stopping, self._hidden_act)

ids = finalize(
Expand Down