Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Core] *Prompt* logprobs support in Multi-step #8199

Merged
merged 66 commits into from
Sep 18, 2024
Merged
Changes from 1 commit
Commits
Show all changes
66 commits
Select commit Hold shift + click to select a range
f97e0ae
added example
afeldman-nm Aug 21, 2024
f969241
wip:
afeldman-nm Aug 21, 2024
642d31b
first working attempt at logprobs
afeldman-nm Aug 21, 2024
a0ca262
merge; format
afeldman-nm Aug 21, 2024
ed97288
passing test; dataclass
afeldman-nm Aug 21, 2024
861e1b9
refactoring
afeldman-nm Aug 21, 2024
8bc0765
Merge branch 'main' into logprobs_merge
afeldman-nm Aug 21, 2024
a34d1ac
refactoring
afeldman-nm Aug 21, 2024
4cda5c0
Merge branch 'logprobs' into logprobs_merge
afeldman-nm Aug 21, 2024
ac8a39a
Merge branch 'main' into logprobs_merge
afeldman-nm Aug 21, 2024
1284327
removing example
afeldman-nm Aug 21, 2024
a6c1207
removed example from build pipeline
afeldman-nm Aug 21, 2024
fe42995
fixed one docstring; embedded NUM_LOGPROBS
afeldman-nm Aug 21, 2024
9fb5bbe
test refactor
afeldman-nm Aug 21, 2024
046a8b1
incremental refactors
afeldman-nm Aug 21, 2024
fa86efd
remove unnecessary conftest change
afeldman-nm Aug 21, 2024
1c0ffb6
Update vllm/model_executor/layers/sampler.py
afeldman-nm Aug 21, 2024
3babadb
refactor
afeldman-nm Aug 21, 2024
f502029
Merge branch 'afeldman-nm/logprobs' of https://github.com/neuralmagic…
afeldman-nm Aug 21, 2024
1875b37
test_multi_step comment
afeldman-nm Aug 21, 2024
3760a95
utils function docstrings
afeldman-nm Aug 21, 2024
d43308c
docstring refactors
afeldman-nm Aug 21, 2024
54db498
merge
afeldman-nm Aug 21, 2024
dfbbaf0
passing tests & formatted
afeldman-nm Aug 21, 2024
5eebfca
Merge branch 'main' into logprobs_merge
afeldman-nm Aug 21, 2024
5e23d9a
Merge branch 'main' into logprobs_merge
afeldman-nm Aug 22, 2024
717efa3
merge; format
afeldman-nm Aug 22, 2024
e0d59ce
removed incorrect SamplerOutput imports
afeldman-nm Aug 22, 2024
102fd92
formatting
afeldman-nm Aug 22, 2024
948f4ef
Update tests/multi_step/test_correctness.py
afeldman-nm Aug 22, 2024
6e6711f
fixed comment
afeldman-nm Aug 22, 2024
f61163e
merge; format
afeldman-nm Aug 23, 2024
1cc93dd
rename
afeldman-nm Aug 23, 2024
4995204
Merge branch 'logprobs' into logprobs_merge
afeldman-nm Aug 23, 2024
da5826b
test modification
afeldman-nm Aug 26, 2024
d4fb430
merge; format
afeldman-nm Aug 26, 2024
b6752e0
merge
afeldman-nm Aug 27, 2024
1e42656
formatting
afeldman-nm Aug 27, 2024
cd0fdf9
disabled logprobs pythonization when logprobs are disabled
afeldman-nm Aug 27, 2024
3fecbc4
wip
afeldman-nm Aug 27, 2024
67bd035
skip logprobs processing entirely when logprobs are not enabled; form…
afeldman-nm Aug 27, 2024
419659d
multi-step output processing; formatting
afeldman-nm Aug 27, 2024
55eaab9
wip
afeldman-nm Aug 27, 2024
bae1fb9
small fixes
afeldman-nm Aug 27, 2024
4c0c9f8
Added prompt logprobs tests
afeldman-nm Aug 27, 2024
c249e51
Merge branch 'main' into logprobs_merge
afeldman-nm Aug 27, 2024
8865bbd
wip
afeldman-nm Aug 27, 2024
e05670b
increased max wait time
afeldman-nm Aug 27, 2024
42af633
formatting
afeldman-nm Aug 27, 2024
81fedc1
upstream merge; upstream formatting issues
afeldman-nm Aug 28, 2024
c6f703d
upstream merge; passing logprobs tests
afeldman-nm Sep 5, 2024
55d7276
Merge branch 'main' into logprobs_merge
afeldman-nm Sep 11, 2024
d8a3f8c
upstream merge; format
afeldman-nm Sep 13, 2024
ad7f261
seems to be passing tests
afeldman-nm Sep 13, 2024
ac4b36f
comments
afeldman-nm Sep 13, 2024
dcad218
refactoring
afeldman-nm Sep 13, 2024
0f373ab
comment
afeldman-nm Sep 13, 2024
9bff9b6
updated prompt logprobs test comment
afeldman-nm Sep 13, 2024
1a28003
updated check_logprobs_close() comment
afeldman-nm Sep 13, 2024
c9d9537
small fix
afeldman-nm Sep 13, 2024
5d64bf3
Update tests/models/utils.py
afeldman-nm Sep 17, 2024
c152446
Update vllm/worker/multi_step_model_runner.py
afeldman-nm Sep 17, 2024
8197219
Update vllm/worker/multi_step_model_runner.py
afeldman-nm Sep 17, 2024
908709c
Update vllm/worker/multi_step_model_runner.py
afeldman-nm Sep 17, 2024
cce5394
addressing feedback
abf149 Sep 17, 2024
7f147d6
Merge branch 'main' into logprobs
abf149 Sep 17, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' into logprobs_merge
  • Loading branch information
afeldman-nm committed Aug 21, 2024
commit ac8a39a1649d222829d30a365b82fa11f7eae640

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.