Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Usage Stats Collection #2852

Merged
merged 62 commits into from
Mar 29, 2024
Merged

Usage Stats Collection #2852

Changes from 1 commit
Commits
Show all changes
62 commits
Select commit Hold shift + click to select a range
e0e1386
Write info to local json
yhu422 Feb 8, 2024
739f4a1
Merge branch 'main' of github.com:vllm-project/vllm into usage
yhu422 Feb 8, 2024
c33b4cc
add usage context
yhu422 Feb 9, 2024
b74e3a6
removed usage_context from Engine_args
yhu422 Feb 9, 2024
c988e07
Move IO to another process
yhu422 Feb 9, 2024
88c5187
added http request
yhu422 Feb 13, 2024
85adbab
Merge branch 'main' of github.com:vllm-project/vllm into usage
yhu422 Feb 13, 2024
33c9dff
Added additional arg for from_engine_args
yhu422 Feb 13, 2024
ad609f0
comments
yhu422 Feb 13, 2024
8a2f18a
Write info to local json
yhu422 Feb 8, 2024
8e9e5be
Merge branch 'usage' of https://github.com/yhu422/vllm into usage
yhu422 Feb 13, 2024
f537692
Added Comments
yhu422 Feb 13, 2024
0f1ba7f
.
yhu422 Feb 13, 2024
abc3948
Collect usage info on engine initialization
yhu422 Feb 8, 2024
ec54145
Merge branch 'usage' of https://github.com/yhu422/vllm into usage
yhu422 Feb 13, 2024
f84ccaa
Write usage to local file for testing
yhu422 Feb 13, 2024
b08ba86
Fixed Formatting
yhu422 Feb 13, 2024
83ff459
Merge branch 'vllm-project:main' into usage
yhu422 Feb 13, 2024
73b689a
formatting changes
yhu422 Feb 13, 2024
86da72f
Merge branch 'usage' of https://github.com/yhu422/vllm into usage
yhu422 Feb 13, 2024
9c9a188
Minor bug fixed
yhu422 Feb 13, 2024
d2f84cf
tmp
yhu422 Feb 13, 2024
4e888e0
Merge branch 'main' of github.com:vllm-project/vllm into usage
yhu422 Feb 13, 2024
eb48061
Fixed Bug
yhu422 Feb 14, 2024
0684c06
Add Google Cloud Run service URL
yhu422 Feb 14, 2024
8e9890e
More GPU CPU Mem info
yhu422 Feb 16, 2024
5cf652a
Merge branch 'main' of github.com:vllm-project/vllm into usage
yhu422 Feb 27, 2024
d910b05
Added context constant
yhu422 Feb 27, 2024
8cf264b
Formatting & CPU Info
yhu422 Feb 27, 2024
93b8773
Update vllm/usage/usage_lib.py
yhu422 Feb 27, 2024
fe39b84
Added CPU info, new stat file path
yhu422 Feb 27, 2024
fc6e374
added gpu memory
yhu422 Feb 27, 2024
ab23171
added memory
yhu422 Feb 28, 2024
686c84a
Distinguish production/testing usage, added custom domain
yhu422 Mar 1, 2024
877eb78
formatting
yhu422 Mar 1, 2024
bc89a66
Merge branch 'main' of github.com:vllm-project/vllm into usage
yhu422 Mar 1, 2024
36fd304
Merge branch 'main' of github.com:vllm-project/vllm into usage
yhu422 Mar 5, 2024
e54f15b
test/prod distinction
yhu422 Mar 5, 2024
4e35b3b
Remove cpuinfo import
yhu422 Mar 5, 2024
a1597fb
ruff
yhu422 Mar 5, 2024
c580797
Merge branch 'main' of github.com:vllm-project/vllm into usage
yhu422 Mar 14, 2024
84353d4
fixed merge
yhu422 Mar 14, 2024
f2e69fc
Pass up model architecture info for GPUExecutor
yhu422 Mar 14, 2024
4e19967
formatting
yhu422 Mar 14, 2024
f327f3c
formatting
yhu422 Mar 14, 2024
d9c8a44
Get architecture directly from configs
yhu422 Mar 14, 2024
59f0f10
Merge branch 'main' of github.com:vllm-project/vllm into usage
simon-mo Mar 16, 2024
f34259a
edits round
simon-mo Mar 17, 2024
30df77c
ruff
simon-mo Mar 17, 2024
60b652b
Merge branch 'main' of github.com:vllm-project/vllm into usage
simon-mo Mar 28, 2024
be91bab
fix format
simon-mo Mar 28, 2024
4f04743
finish all code level functionality
simon-mo Mar 28, 2024
f4bf862
add wip doc
simon-mo Mar 28, 2024
6b968db
Merge branch 'main' of github.com:vllm-project/vllm into usage
simon-mo Mar 28, 2024
2006788
revert some fixes
simon-mo Mar 28, 2024
db715c8
more fixes
simon-mo Mar 28, 2024
2c1e557
finish doc, readability pass
simon-mo Mar 28, 2024
42e66b8
edit pass
simon-mo Mar 28, 2024
a4e5742
fix doc and isort
simon-mo Mar 28, 2024
9652830
Merge branch 'main' of github.com:vllm-project/vllm into usage
simon-mo Mar 29, 2024
ba63b44
bad merge
simon-mo Mar 29, 2024
58fb78d
add to amd req txt
simon-mo Mar 29, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Merge branch 'main' of github.com:vllm-project/vllm into usage
  • Loading branch information
@yhu422
yhu422 committed Mar 5, 2024
commit 36fd30400eae1dd154fc30360806eca99c275aa8

This merge commit was added into this branch cleanly.

There are no new changes to show, but you can still view the diff.