Skip to content

Commit c0c86c2

Browse files
committed
fix text config
Signed-off-by: Isotr0py <2037008807@qq.com>
1 parent a985145 commit c0c86c2

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/model_loader/loader.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -1271,7 +1271,7 @@ def _get_gguf_weights_map(self, model_config: ModelConfig):
12711271
See "Standardized tensor names" in
12721272
https://github.com/ggerganov/ggml/blob/master/docs/gguf.md for details.
12731273
"""
1274-
config = copy.deepcopy(model_config.hf_config)
1274+
config = copy.deepcopy(model_config.hf_text_config)
12751275
model_type = config.model_type
12761276
gguf_to_hf_name_map = {}
12771277
# hack: ggufs have a different name than transformers

0 commit comments

Comments
 (0)