Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Update server.cpp with min_p after it was introduced in #3841 #3877

Merged
merged 4 commits into from
Nov 9, 2023
Merged

Update server.cpp with min_p after it was introduced in #3841 #3877

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
a7449e8
Update server.cpp with min_p after it was introduced in https://githu…
Mihaiii Oct 31, 2023
77931e7
Use spaces instead of tabs
Mihaiii Oct 31, 2023
82fdee6
Update index.html.hpp after running deps.sh
Mihaiii Oct 31, 2023
6ce46c5
Fix test - fix line ending
Mihaiii Oct 31, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions examples/server/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -122,6 +122,8 @@ node index.js

`top_p`: Limit the next token selection to a subset of tokens with a cumulative probability above a threshold P (default: 0.95).

`min_p`: The minimum probability for a token to be considered, relative to the probability of the most likely token (default: 0.05).

`n_predict`: Set the maximum number of tokens to predict when generating text. **Note:** May exceed the set limit slightly if the last token is a partial multibyte character. When 0, no tokens will be generated but the prompt is evaluated into the cache. (default: -1, -1 = infinity).

`n_keep`: Specify the number of tokens from the prompt to retain when the context size is exceeded and tokens need to be discarded.
Expand Down
Loading