Skip to content

Commit 1aaccff

Browse files
committed
rebase
1 parent e910051 commit 1aaccff

File tree

1 file changed

+0
-1
lines changed

1 file changed

+0
-1
lines changed

vllm/worker/cpu_model_runner.py

Lines changed: 0 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -397,7 +397,6 @@ def profile_run(self) -> None:
397397
model_config = self.model_config
398398
vlm_config = self.vision_language_config
399399

400-
# Enable top-k sampling to reflect the accurate memory usage.
401400
sampling_params = SamplingParams(top_p=0.99, top_k=self.vocab_size - 1)
402401
max_num_batched_tokens = min(
403402
self.scheduler_config.max_num_batched_tokens,

0 commit comments

Comments
 (0)