Skip to content

Commit

Permalink
update user guide
Browse files Browse the repository at this point in the history
  • Loading branch information
lvhan028 committed Nov 1, 2024
1 parent 103e9ad commit 68eb282
Show file tree
Hide file tree
Showing 2 changed files with 8 additions and 0 deletions.
4 changes: 4 additions & 0 deletions docs/en/llm/pipeline.md
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,10 @@ logits = pipe.get_logits(input_ids)
ppl = pipe.get_ppl(input_ids)
```

```{note}
get_ppl returns the cross entropy loss without applying the exponential operation afterwards
```

- **Below is an example for pytorch backend. Please install triton first.**

```shell
Expand Down
4 changes: 4 additions & 0 deletions docs/zh_cn/llm/pipeline.md
Original file line number Diff line number Diff line change
Expand Up @@ -136,6 +136,10 @@ logits = pipe.get_logits(input_ids)
ppl = pipe.get_ppl(input_ids)
```

```{note}
get_ppl 返回的是 cross entropy loss,没有在之后加 exp 操作
```

- **使用 pytorch 后端**

需要先安装 triton
Expand Down

0 comments on commit 68eb282

Please sign in to comment.