Skip to content

Commit 528e7ac

Browse files
Isotr0pyjikunshang
authored andcommitted
[Model] Consolidate Deepseek-MoE implementation with DeepSeek-v2 (vllm-project#28101)
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com> Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
1 parent 98ac96a commit 528e7ac

File tree

6 files changed

+144
-548
lines changed

6 files changed

+144
-548
lines changed

tests/models/registry.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -219,7 +219,10 @@ def check_available_online(
219219
"nvidia/Llama-3_3-Nemotron-Super-49B-v1",
220220
trust_remote_code=True,
221221
),
222-
"DeepseekForCausalLM": _HfExamplesInfo("deepseek-ai/deepseek-llm-7b-chat"),
222+
"DeepseekForCausalLM": _HfExamplesInfo(
223+
"deepseek-ai/deepseek-moe-16b-base",
224+
trust_remote_code=True,
225+
),
223226
"DeepseekV2ForCausalLM": _HfExamplesInfo(
224227
"deepseek-ai/DeepSeek-V2-Lite-Chat",
225228
trust_remote_code=True,

0 commit comments

Comments
 (0)