[Model] Upstream Deepseek-OCR model #27247

Isotr0py · 2025-10-21T06:07:20Z

Purpose

Fix [New Model]: deepseek-ai/DeepSeek-OCR upstream support #27236
See if we can reuse deepseek-vl2's implementation and clip's implementation as much as possible

Test Plan

Test Result

Essential Elements of an Effective PR Description Checklist

The purpose of the PR, such as "Fix some issue (link existing issues this PR will resolve)".
The test plan, such as providing test command.
The test results, such as pasting the results comparison before and after, or e2e results
(Optional) The necessary documentation update, such as updating supported_models.md and examples for a new model.
(Optional) Release notes update. If your change is user facing, please update the release notes draft in the Google Doc.

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify · 2025-10-21T14:54:50Z

Documentation preview: https://vllm--27247.org.readthedocs.build/en/27247/

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Isotr0py · 2025-10-21T16:57:24Z

The model should work now, but we really need a full clean for commented debug codes from upstream codebase everywhere. 😅

ywang96 · 2025-10-21T17:00:02Z

The model should work now, but we really need a full clean for commented debug codes from upstream codebase everywhere. 😅

I'll clean it up - thanks for your work!

Signed-off-by: Roger Wang <hey@rogerw.io>

chatgpt-codex-connector

💡 Codex Review

Here are some automated review suggestions for this pull request.

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

Open a pull request for review
Mark a draft as ready
Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

vllm/model_executor/models/deepseek_ocr.py

Signed-off-by: Roger Wang <hey@rogerw.io>

ywang96

Since the model implementation and sampling params have been verified by the original model author, let's get this in!

Signed-off-by: Roger Wang <hey@rogerw.io>

jeejeelee · 2025-10-22T07:57:14Z

We also need to update https://github.com/vllm-project/vllm/blob/main/tests/models/registry.py

Signed-off-by: Roger Wang <hey@rogerw.io>

vllm/model_executor/models/deepseek_ocr.py

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: Roger Wang <hey@rogerw.io>

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: Roger Wang <hey@rogerw.io> Signed-off-by: Alberto Perdomo <aperdomo@redhat.com>

YosanHo · 2025-10-24T07:02:02Z

@Isotr0py how to request deepseek-ocr with http request, can u give an example?

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: Roger Wang <hey@rogerw.io>

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: Roger Wang <hey@rogerw.io> Signed-off-by: 0xrushi <6279035+0xrushi@users.noreply.github.com>

Isotr0py added 2 commits October 21, 2025 13:52

draft

29b9c6d

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

draft

3473ffb

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot added the deepseek Related to DeepSeek models label Oct 21, 2025

register

2175993

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot added the new-model Requests to new models label Oct 21, 2025

Isotr0py added 7 commits October 21, 2025 14:15

register

c7ffb81

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

fix processor

7256000

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

fix lm backbone loading

63c220a

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

fix all weights loading?

b012462

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

fix vit

e5d3dfc

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

fix projector

f87ada5

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

update example

2ac4a73

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

mergify bot added the documentation Improvements or additions to documentation label Oct 21, 2025

clean

e1ada73

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Isotr0py assigned Isotr0py and ywang96 Oct 21, 2025

Isotr0py added 4 commits October 21, 2025 23:10

fix online serving

4ccdf97

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

clean

e79819d

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

impl ngram logits processor

521037f

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

correct chat template

3a3080f

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ywang96 added 3 commits October 21, 2025 22:41

clean up processor

bbe0264

Signed-off-by: Roger Wang <hey@rogerw.io>

cleanup main modeling code

c29f9bd

Signed-off-by: Roger Wang <hey@rogerw.io>

remove repetitive constants

12a3782

Signed-off-by: Roger Wang <hey@rogerw.io>

ywang96 changed the title ~~[WIP][Model] Upstream Deepseek-OCR model~~ [Model] Upstream Deepseek-OCR model Oct 21, 2025

Merge branch 'main' into deepseek-ocr

2a33b30

ywang96 marked this pull request as ready for review October 21, 2025 23:26

chatgpt-codex-connector bot reviewed Oct 21, 2025

View reviewed changes

vllm/model_executor/models/deepseek_ocr.py Show resolved Hide resolved

ywang96 added 4 commits October 22, 2025 06:56

align sampling params

d035632

Signed-off-by: Roger Wang <hey@rogerw.io>

Merge branch 'main' into deepseek-ocr

1b1ebb3

note

6cc48c3

Signed-off-by: Roger Wang <hey@rogerw.io>

add to doc

554a361

Signed-off-by: Roger Wang <hey@rogerw.io>

ywang96 added the ready ONLY add when PR is ready to merge/full CI is needed label Oct 22, 2025

ywang96 approved these changes Oct 22, 2025

View reviewed changes

jeejeelee approved these changes Oct 22, 2025

View reviewed changes

ywang96 added 2 commits October 22, 2025 07:50

precommit

63e3c06

Signed-off-by: Roger Wang <hey@rogerw.io>

precommit

c8f2e80

Signed-off-by: Roger Wang <hey@rogerw.io>

add to registry

ffd9154

Signed-off-by: Roger Wang <hey@rogerw.io>

ywang96 requested a review from DarkLight1337 as a code owner October 22, 2025 08:10

ywang96 added 3 commits October 22, 2025 08:32

cleanup

6234a09

Signed-off-by: Roger Wang <hey@rogerw.io>

fix

614e8bc

Signed-off-by: Roger Wang <hey@rogerw.io>

Merge branch 'main' into deepseek-ocr

6f890c0

ywang96 enabled auto-merge (squash) October 22, 2025 09:06

DarkLight1337 reviewed Oct 22, 2025

View reviewed changes

vllm/model_executor/models/deepseek_ocr.py Show resolved Hide resolved

vllm-bot merged commit 675aa2e into vllm-project:main Oct 22, 2025
53 of 55 checks passed

DarkLight1337 added this to the v0.11.1 milestone Oct 22, 2025

Isotr0py deleted the deepseek-ocr branch October 22, 2025 17:32

Isotr0py mentioned this pull request Oct 22, 2025

[Bugfix] Fix deepseek-ocr multi-image inference and add merge_by_field_config=True with tensor schema support #27361

Merged

5 tasks

Kay-Tian mentioned this pull request Oct 23, 2025

vLLM PR #27247 变更核心文件提醒 Kay-Tian/vllm#11

Closed

usberkeley pushed a commit to usberkeley/vllm that referenced this pull request Oct 23, 2025

[Model] Upstream Deepseek-OCR model (vllm-project#27247)

2eda36e

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: Roger Wang <hey@rogerw.io>

weedge mentioned this pull request Oct 24, 2025

feat: add llm_vllm_deepseek_ocr and llm_office_vllm_deepseek_ocr ai-bot-pro/achatbot#205

Merged

kingsmad pushed a commit to kingsmad/vllm that referenced this pull request Oct 25, 2025

[Model] Upstream Deepseek-OCR model (vllm-project#27247)

7b6af0a

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn> Signed-off-by: Roger Wang <hey@rogerw.io> Co-authored-by: Roger Wang <hey@rogerw.io>

Kay-Tian mentioned this pull request Oct 26, 2025

vLLM PR #27247 变更核心文件提醒 Kay-Tian/vllm#47

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Uh oh!

[Model] Upstream Deepseek-OCR model #27247

[Model] Upstream Deepseek-OCR model #27247

Isotr0py commented Oct 21, 2025 •

edited by github-actions bot

Loading

Uh oh!

mergify bot commented Oct 21, 2025

Uh oh!

Isotr0py commented Oct 21, 2025 •

edited

Loading

Uh oh!

ywang96 commented Oct 21, 2025

Uh oh!

chatgpt-codex-connector bot left a comment

Uh oh!

Uh oh!

ywang96 left a comment

Uh oh!

jeejeelee commented Oct 22, 2025

Uh oh!

Uh oh!

Uh oh!

YosanHo commented Oct 24, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

Uh oh!

[Model] Upstream Deepseek-OCR model #27247

[Model] Upstream Deepseek-OCR model #27247

Conversation

Isotr0py commented Oct 21, 2025 • edited by github-actions bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Purpose

Test Plan

Test Result

Uh oh!

mergify bot commented Oct 21, 2025

Uh oh!

Isotr0py commented Oct 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

ywang96 commented Oct 21, 2025

Uh oh!

chatgpt-codex-connector bot left a comment

Choose a reason for hiding this comment

💡 Codex Review

Uh oh!

Uh oh!

ywang96 left a comment

Choose a reason for hiding this comment

Uh oh!

jeejeelee commented Oct 22, 2025

Uh oh!

Uh oh!

Uh oh!

YosanHo commented Oct 24, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

8 participants

Isotr0py commented Oct 21, 2025 •

edited by github-actions bot

Loading

Isotr0py commented Oct 21, 2025 •

edited

Loading