[New Model] DeepSeek-V3.2 (Rebased to Main) #25896

zyongye · 2025-09-29T17:17:13Z

Rebased dsv32, based on #25869

Run command

vllm serve deepseek-ai/DeepSeek-V3.2-Exp  --max_model_len=20000 --gpu_memory_utilization=0.9 -tp 8 --max_num_seqs=256

gsm8k

|Tasks|Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k|      3|flexible-extract|     5|exact_match|↑  |0.9568|±  |0.0056|
|     |       |strict-match    |     5|exact_match|↑  |0.9575|±  |0.0056|

gsm8k, 20-shot

|Tasks|Version|     Filter     |n-shot|  Metric   |   |Value |   |Stderr|
|-----|------:|----------------|-----:|-----------|---|-----:|---|-----:|
|gsm8k|      3|flexible-extract|    20|exact_match|↑  |0.9507|±  | 0.006|
|     |       |strict-match    |    20|exact_match|↑  |0.9507|±  | 0.006|

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> fix smoke tests Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> moved to FlashMLA repo Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> removed pytorch shim Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

setup sparse attention backend

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

…ild-sparse-flash-mla Build and bind sparse-FlashMLA kernels

…integration [Feature] DeepGEMM integration

* and env and MQA path for both prefill and decode Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> * fix shapes Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> --------- Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

* code from ds Signed-off-by: youkaichao <youkaichao@gmail.com> * doc from ds Signed-off-by: youkaichao <youkaichao@gmail.com> * Fixes for support_materials/2-tilelang/ Signed-off-by: mgoin <mgoin64@gmail.com> * Fix example 1 Signed-off-by: mgoin <mgoin64@gmail.com> * Fix Einsum in deepgemm * Fix `libc10.so` unimported error * fix reference code Signed-off-by: youkaichao <youkaichao@gmail.com> * adding missing indexer args * passing index args into the module * init Signed-off-by: Chen Zhang <zhangch99@outlook.com> * build indexer k cache medadata * prefill indexer, but weight_proj will output -inf * unqiantized paged indexer, still have -inf issue * remove support material * adding topk_indices mask * add weight scale * unittest infrastructure and fix weight_proj, numeric error due to quantization * varlen prefill passed * paged prefill * add indices mask --------- Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com>

Co-authored-by: Lucia Fang <fanglu@meta.com>

* prefill mla Signed-off-by: Chen Zhang <zhangch99@outlook.com> * can run now Signed-off-by: Chen Zhang <zhangch99@outlook.com> * tmp Signed-off-by: Chen Zhang <zhangch99@outlook.com> * can output the first token Signed-off-by: Chen Zhang <zhangch99@outlook.com> * fix bug Signed-off-by: Chen Zhang <zhangch99@outlook.com> * remove some debug Signed-off-by: Chen Zhang <zhangch99@outlook.com> * update Signed-off-by: Chen Zhang <zhangch99@outlook.com> * hack through cu_seqlen_ks exploding issue * update basic.py Signed-off-by: Chen Zhang <zhangch99@outlook.com> * remove some unnecessary changes Signed-off-by: Chen Zhang <zhangch99@outlook.com> * clean up Signed-off-by: Chen Zhang <zhangch99@outlook.com> --------- Signed-off-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

Signed-off-by: NickLucche <nlucches@redhat.com>

Fix MLA for non dsv32 models

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

youkaichao · 2025-09-30T09:14:21Z

the issue reported by @heheda12345 seems to be kvcache dtype issue.

merging first to unblock further optimizations. @LucasWilkinson might help investigate further.

cjackal · 2025-09-30T10:50:51Z

Seems like DSV3 AWQ quantized checkpoints are broken after this PR; the error message is like the following, let me write an issue for it:

RuntimeError: Expected q.dtype() == torch::kFloat8_e4m3fn to be true, but got false. (Could this error message be improved? If so, please report an enhancement request to PyTorch.)

njhill · 2025-09-30T15:52:44Z

A CI test was reportedly broken by this (now failing on main):

[2025-09-30T15:41:37Z] FAILED v1/spec_decode/test_eagle.py::test_load_model[True-1-FLASH_ATTN-eagle] - RuntimeError: generator raised StopIteration

https://buildkite.com/vllm/ci/builds/32959#01999b1b-bec0-44a2-bca0-2523a6209558

Edit: I have opened a fix here: #25978

youkaichao · 2025-09-30T16:31:35Z

@heheda12345 @cjackal can you help check if #25956 solves the problem?

… still failing tests (#292) vllm-project/vllm#25896 --------- Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>

cjackal · 2025-10-01T03:23:21Z

@heheda12345 @cjackal can you help check if #25956 solves the problem?

Confirmed that it works normal after your PR, thank you for the prompt bugfix!

Signed-off-by: Chen Zhang <zhangch99@outlook.com> Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com> Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Lucia Fang <fanglu@meta.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com> Co-authored-by: Lucia Fang <fanglu@meta.com> Co-authored-by: NickLucche <nlucches@redhat.com> Co-authored-by: Siyuan Fu <siyuanf@nvidia.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Xiaozhu Meng <mxz297@gmail.com> Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: simon-mo <simon.mo@hey.com>

… still failing tests (vllm-project#292) vllm-project/vllm#25896 --------- Signed-off-by: Chendi Xue <Chendi.Xue@intel.com> Signed-off-by: Iryna Boiko <iboiko@habana.ai>

Signed-off-by: Chen Zhang <zhangch99@outlook.com> Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com> Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Lucia Fang <fanglu@meta.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com> Co-authored-by: Lucia Fang <fanglu@meta.com> Co-authored-by: NickLucche <nlucches@redhat.com> Co-authored-by: Siyuan Fu <siyuanf@nvidia.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Xiaozhu Meng <mxz297@gmail.com> Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com> Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com> Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Lucia Fang <fanglu@meta.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com> Co-authored-by: Lucia Fang <fanglu@meta.com> Co-authored-by: NickLucche <nlucches@redhat.com> Co-authored-by: Siyuan Fu <siyuanf@nvidia.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Xiaozhu Meng <mxz297@gmail.com> Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com> Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com> Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Lucia Fang <fanglu@meta.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com> Co-authored-by: Lucia Fang <fanglu@meta.com> Co-authored-by: NickLucche <nlucches@redhat.com> Co-authored-by: Siyuan Fu <siyuanf@nvidia.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Xiaozhu Meng <mxz297@gmail.com> Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com> Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com> Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Lucia Fang <fanglu@meta.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com> Co-authored-by: Lucia Fang <fanglu@meta.com> Co-authored-by: NickLucche <nlucches@redhat.com> Co-authored-by: Siyuan Fu <siyuanf@nvidia.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Xiaozhu Meng <mxz297@gmail.com> Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: xuebwang-amd <xuebwang@amd.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com> Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com> Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Lucia Fang <fanglu@meta.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com> Co-authored-by: Lucia Fang <fanglu@meta.com> Co-authored-by: NickLucche <nlucches@redhat.com> Co-authored-by: Siyuan Fu <siyuanf@nvidia.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Xiaozhu Meng <mxz297@gmail.com> Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: simon-mo <simon.mo@hey.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com> Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com> Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Lucia Fang <fanglu@meta.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com> Co-authored-by: Lucia Fang <fanglu@meta.com> Co-authored-by: NickLucche <nlucches@redhat.com> Co-authored-by: Siyuan Fu <siyuanf@nvidia.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Xiaozhu Meng <mxz297@gmail.com> Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>

Signed-off-by: Chen Zhang <zhangch99@outlook.com> Signed-off-by: youkaichao <youkaichao@gmail.com> Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> Signed-off-by: mgoin <mgoin64@gmail.com> Signed-off-by: NickLucche <nlucches@redhat.com> Signed-off-by: Yongye Zhu <zyy1102000@gmail.com> Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: Lucia Fang <fanglu@meta.com> Co-authored-by: Chen Zhang <zhangch99@outlook.com> Co-authored-by: youkaichao <youkaichao@gmail.com> Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com> Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com> Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com> Co-authored-by: yewentao256 <zhyanwentao@126.com> Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com> Co-authored-by: mgoin <mgoin64@gmail.com> Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com> Co-authored-by: Lucia Fang <fanglu@meta.com> Co-authored-by: NickLucche <nlucches@redhat.com> Co-authored-by: Siyuan Fu <siyuanf@nvidia.com> Co-authored-by: Matthew Bonanni <mbonanni@redhat.com> Co-authored-by: Xiaozhu Meng <mxz297@gmail.com> Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com> Signed-off-by: xuebwang-amd <xuebwang@amd.com>

heheda12345 and others added 30 commits September 20, 2025 18:24

init dev branch

12f85fb

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

add indexer module

1486830

Signed-off-by: youkaichao <youkaichao@gmail.com>

fix fp8 weight loading

ee3271e

Signed-off-by: youkaichao <youkaichao@gmail.com>

fix key

3f4154d

Signed-off-by: youkaichao <youkaichao@gmail.com>

basic test

991b94f

Signed-off-by: youkaichao <youkaichao@gmail.com>

add indexer cache (vllm-project#12)

00c455c

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

setup sparse attention backend

ddaf933

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

build sparse

aff9596

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> fix smoke tests Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> moved to FlashMLA repo Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com> removed pytorch shim Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

pass in selected index

22d0fe5

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

make basic.py runable

3b9df19

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

small fix

f85564f

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

reduce api change

fe45b06

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

revert

216c42f

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

Merge pull request vllm-project#14 from vllm-model-0920/mla_backend

446c0de

setup sparse attention backend

format

840f205

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

Merge pull request vllm-project#13 from vllm-model-0920/lwilkinson/bu…

fa13a8b

…ild-sparse-flash-mla Build and bind sparse-FlashMLA kernels

deepgemm integration

0f54ca6

fix clean logic

93eade0

Merge pull request vllm-project#20 from vllm-model-0920/wye-deepgemm-…

1e304d8

…integration [Feature] DeepGEMM integration

support mtp with indexer kv (vllm-project#21)

6a29a01

Co-authored-by: Lucia Fang <fanglu@meta.com>

fix indexer bs>1 (vllm-project#23)

75d382e

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

fix build

9905f9d

Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

fix import (vllm-project#24)

23e809c

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

enable sparse by default

e19d0c9

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

fix mla

bff5944

Signed-off-by: NickLucche <nlucches@redhat.com>

Merge pull request vllm-project#28 from vllm-model-0920/fix

d689f18

Fix MLA for non dsv32 models

fix unify kv cache spec

b3a44bd

Signed-off-by: Chen Zhang <zhangch99@outlook.com>

youkaichao merged commit fa7e254 into vllm-project:main Sep 30, 2025
63 of 80 checks passed

zyongye deleted the dsv32-base branch September 30, 2025 12:50

createthis mentioned this pull request Sep 30, 2025

Feature Request: DeepSeek V3.2-Exp support ggml-org/llama.cpp#16331

Open

4 tasks

sdavidbd mentioned this pull request Sep 30, 2025

[V1] [P/D] Add Support for KV Load Failure Recovery #19330

Merged

youkaichao mentioned this pull request Sep 30, 2025

[bugfix][deepseek] fix flashmla kernel selection #25956

Merged

5 tasks

xuechendi mentioned this pull request Sep 30, 2025

[FIX_FOR_VLLM_LATEST] fix issue introduced by PR25896 and comment out still failing tests vllm-project/vllm-gaudi#292

Merged

xuechendi added a commit to vllm-project/vllm-gaudi that referenced this pull request Sep 30, 2025

[FIX_FOR_VLLM_LATEST] fix issue introduced by PR25896 and comment out…

c10d05f

… still failing tests (#292) vllm-project/vllm#25896 --------- Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>

njhill mentioned this pull request Sep 30, 2025

[BugFix] Fix eagle test broken by DeepSeek-V3.2 PR #25978

Closed

karan mentioned this pull request Sep 30, 2025

Fix use of MLA vllm-project/tpu-inference#766

Merged

gshtras mentioned this pull request Oct 1, 2025

[ROCm][Bugfix] Add missing parameter to ROCm backend #26029

Merged

This was referenced Oct 3, 2025

[vllm hash update] update the pinned vllm hash pytorch/pytorch#164319

Closed

Add deepseek-ai/DeepSeek-V3.2-Exp pytorch/pytorch-integration-testing#88

Merged

rhluo mentioned this pull request Oct 20, 2025

[Fix][Hybrid] wrong page size bytes for mla attention #27185

Open

jakexcosme mentioned this pull request Oct 22, 2025

Feature Request: DeepSeek V3.2-Exp support COG-GTM/llama.cpp#89

Open

4 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[New Model] DeepSeek-V3.2 (Rebased to Main) #25896

[New Model] DeepSeek-V3.2 (Rebased to Main) #25896

zyongye commented Sep 29, 2025 •

edited by github-actions bot

Loading

Uh oh!

youkaichao commented Sep 30, 2025

Uh oh!

Uh oh!

cjackal commented Sep 30, 2025

Uh oh!

njhill commented Sep 30, 2025 •

edited

Loading

Uh oh!

youkaichao commented Sep 30, 2025

Uh oh!

cjackal commented Oct 1, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

15 participants

Uh oh!

[New Model] DeepSeek-V3.2 (Rebased to Main) #25896

[New Model] DeepSeek-V3.2 (Rebased to Main) #25896

Conversation

zyongye commented Sep 29, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

youkaichao commented Sep 30, 2025

Uh oh!

Uh oh!

cjackal commented Sep 30, 2025

Uh oh!

njhill commented Sep 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

youkaichao commented Sep 30, 2025

Uh oh!

cjackal commented Oct 1, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

15 participants

zyongye commented Sep 29, 2025 •

edited by github-actions bot

Loading

njhill commented Sep 30, 2025 •

edited

Loading