Skip to content

Commit 77e4472

Browse files
let draft model follow target model's config_format (#30152)
1 parent 962d703 commit 77e4472

File tree

1 file changed

+1
-0
lines changed

1 file changed

+1
-0
lines changed

vllm/config/speculative.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -337,6 +337,7 @@ def __post_init__(self):
337337
enforce_eager=self.target_model_config.enforce_eager,
338338
max_logprobs=self.target_model_config.max_logprobs,
339339
hf_overrides=SpeculativeConfig.hf_config_override,
340+
config_format=self.target_model_config.config_format,
340341
)
341342

342343
# Automatically detect the method

0 commit comments

Comments
 (0)