Update faq question for inbatch model loading simcse checkpoint and o… #2786
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
…ptimize the code and readme
w5688414
added
documentation
tianxin1860
reviewed
Jul 12, 2022
| @@ -588,6 +588,30 @@ outputs { | |||
| ``` | |||
| 可以看到服务端返回了向量 | |||
|
|
|||
| ## FAQ | |||
|
|
|||
| #### 怎样加载SimCSE训练的模型？ | |||
There was a problem hiding this comment.
如何基于无监督SimCSE训练出的模型参数作为参数初始化继续做有监督 In-Batch Negative 训练？
| @@ -57,5 +58,5 @@ python -u -m paddle.distributed.launch --gpus "0,1,2,3" \ | |||
| # --save_steps 10 \ | |||
| # --max_seq_length 64 \ | |||
| # --margin 0.2 \ | |||
| # --train_set_file data/${root_path}/train.csv \ | |||
| # --train_set_file recall/train.csv \ | |||
| # --init_from_ckpt simcse/post_model_10000/model_state.pdparams | |||
There was a problem hiding this comment.
这是给的加载SimCSE的示例和加载postraing模型的示例，我觉得放在那里可以给用户一个参考
| @@ -206,6 +206,6 @@ python3 inference.py | |||
| ``` | |||
| ## FAQ | |||
|
|
|||
| ### 句子抽取向量后，利用milvus进行检索到了相同的句子，得到的距离不是0 | |||
| #### 句子抽取向量后，利用milvus进行检索到了相同的句子，得到的距离不是0 | |||
There was a problem hiding this comment.
抽取文本语义向量后，利用 Milvus 进行 ANN 检索查询到了完全相同的文本，但是计算出的距离为什么不是 0？
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
…ptimize the code and readme
PR types
#2783
PR changes
Docs
Description