Skip to content

Commit

Permalink
[Bugfix] Remove the last EOS token unless explicitly specified (vllm-…
Browse files Browse the repository at this point in the history
  • Loading branch information
jsato8094 authored and blinkbear committed Jun 6, 2024
1 parent b18e919 commit d58f01f
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion tests/engine/output_processor/test_stop_checker.py
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,8 @@ def sequence_with_eos(text: str, eos_token: str,
"""
seq = Sequence(
seq_id=0,
inputs={"prompt_token_ids": []},
prompt="",
prompt_token_ids=[],
block_size=16,
eos_token_id=eos_token_id,
)
Expand Down

0 comments on commit d58f01f

Please sign in to comment.