Modify Bert Docstring #914
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
yingyibiao
reviewed
Aug 23, 2021
yingyibiao
reviewed
Aug 23, 2021
yingyibiao
reviewed
Aug 24, 2021
yingyibiao
reviewed
Aug 24, 2021
yingyibiao
reviewed
Aug 24, 2021
yingyibiao
reviewed
Aug 26, 2021
Comment on lines
558
to
566
| - `start_logits` (Tensor): | ||
| Labels for position (index) of the start of the labelled span. Positions are clamped to the sequence length. | ||
| Position outside of the sequence are not taken into account for computing the token classification loss. | ||
| Its data type should be float32 and its shape is [batch_size, sequence_length]. | ||
|
|
||
| - `end_logits` (Tensor): | ||
| Labels for position (index) of the end of the labelled span. Positions are clamped to the sequence length. | ||
| Position outside of the sequence are not taken into account for computing the token classification loss. | ||
| Its data type should be float32 and its shape is [batch_size, sequence_length]. |
There was a problem hiding this comment.
start_logits和end_logits的描述有问题，他们不是输入的label，他们是我们对输入序列每一个位置输出的logits
Comment on lines
446
to
455
| attention_mask (Tensor, optional): | ||
| Mask used in multi-head attention to avoid performing attention on to some unwanted positions, | ||
| usually the paddings or the subsequent positions. | ||
| The values should be either 0 or 1. | ||
|
|
||
| - **1** for tokens that **not masked**, | ||
| - **0** for tokens that **masked**. | ||
|
|
||
| It's data type should be float32 and its shape is [batch_size, num_attention_heads, sequence_length, sequence_length]. | ||
| Defaults to `None`. |
There was a problem hiding this comment.
这里的dtype可以是int，float，bool
shape只要能够broadcasted到对应的shape就可以
There was a problem hiding this comment.
dtype为float，bool的时候分别是什么行为呢
yingyibiao
reviewed
Aug 26, 2021
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
PR types
PR changes
Description