Skip to content

Commit ed5dab9

Browse files
KuntaiDurasmith
authored andcommitted
Doc fix in benchmark_long_document_qa_throughput.py (vllm-project#11933)
Signed-off-by: Kuntai Du <kuntai@uchicago.edu>
1 parent 2f6dc44 commit ed5dab9

File tree

1 file changed

+1
-2
lines changed

1 file changed

+1
-2
lines changed

benchmarks/benchmark_long_document_qa_throughput.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -2,8 +2,7 @@
22
Offline benchmark to test the long document QA throughput.
33
44
Example usage:
5-
# This command run the vllm with 50GB CPU memory for offloading
6-
# The workload samples 8 different prompts with a default input
5+
# This workload samples 8 different prompts with a default input
76
# length of 20000 tokens, then replicates each prompt 2 times
87
# in random order.
98
python benchmark_long_document_qa_throughput.py \

0 commit comments

Comments
 (0)