Skip to content

Commit 1293a64

Browse files
author
xusenlin
committed
fix vllm server for additional parameters
1 parent bacc7b6 commit 1293a64

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

api/vllm_server.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -396,6 +396,7 @@ async def create_completion(raw_request: Request):
396396
presence_penalty=request.presence_penalty,
397397
frequency_penalty=request.frequency_penalty,
398398
temperature=request.temperature,
399+
top_p=request.top_p,
399400
top_k=request.top_k,
400401
stop=request.stop,
401402
ignore_eos=request.ignore_eos,

0 commit comments

Comments
 (0)