[OpenVINO][Draft]add support for dinov3 #1431

openvino-dev-samples · 2025-08-21T05:21:39Z

What does this PR do?

Conversion cmd-line for DINOv3:

optimum-cli export openvino --task feature-extraction --model facebook/dinov3-convnext-tiny-pretrain-lvd1689m dinov3-convnext-tiny-pretrain-lvd1689m-ov

Inference of DINOv3 using OpenVINO backend:

from optimum.intel import OVModelForCustomTasks
import torch
from transformers import AutoImageProcessor
from transformers.image_utils import load_image

url = "http://images.cocodataset.org/val2017/000000039769.jpg"
image = load_image(url)

pretrained_model_name = "dinov3-convnext-tiny-pretrain-lvd1689m-ov"
processor = AutoImageProcessor.from_pretrained(pretrained_model_name)
model = OVModelForCustomTasks.from_pretrained(
    pretrained_model_name, 
    device_map="cpu", 
)

inputs = processor(images=image, return_tensors="pt").to(model.device)
print(inputs)
with torch.inference_mode():
    outputs = model(**inputs)

pooled_output = outputs.pooler_output
print("Pooled output shape:", pooled_output.shape)

Before submitting

Did you make sure to update the documentation with your changes?
Did you write any new necessary tests?

echarlaix

thanks for the addition @openvino-dev-samples, transformers v4.55 will soon be supported (once #1406 is merged), would you mind adding tests with tiny models ?

rkazants

please add tests to check inference. Now it is tests only export

echarlaix

Thanks for the PR @openvino-dev-samples

tests/openvino/utils_tests.py

echarlaix · 2025-09-19T08:59:38Z

optimum/exporters/openvino/model_configs.py

+@register_in_tasks_manager("dinov3_vit", *["feature-extraction"], library_name="transformers")
+@register_in_tasks_manager("dinov3_convnext", *["feature-extraction"], library_name="transformers")


thanks for adding a tests for dinov3_vit! Would you mind adding a test for dinov3_convnext as well ? (to make sure support is not broken in the future)

also why not add the "image-classification" task ?

Dinov3 is not included in AutoModelForImageClassification.
Any suggestion ?

optimum/exporters/openvino/model_configs.py

echarlaix · 2025-09-19T09:21:13Z

the PR #1406 is now merged !

Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>

optimum/exporters/openvino/model_configs.py

echarlaix · 2025-09-29T07:56:52Z

tests/openvino/test_exporters_cli.py

            ]
        )
+
+    if is_transformers_version(">=", "4.56"):


let's wait for us to support transformers v4.56 before merging so that we are sure all tests are triggered and pass

echarlaix · 2025-12-02T15:12:57Z

Hi @openvino-dev-samples #1529 adds support for transformers v4.56!

HuggingFaceDocBuilderDev · 2025-12-02T15:14:07Z

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.

optimum/exporters/openvino/model_configs.py

echarlaix · 2025-12-02T15:18:49Z

tests/openvino/test_modeling.py

 class OVModelForCustomTasksIntegrationTest(unittest.TestCase):
    SUPPORTED_ARCHITECTURES_WITH_ATTENTION = ["vit-with-attentions"]
    SUPPORTED_ARCHITECTURES_WITH_HIDDEN_STATES = ["vit-with-hidden-states"]
+    SUPPORTED_ARCHITECTURES_WITH_HIDDEN_STATES = ["dinov3_vit"]


why not add a test directly under

optimum-intel/tests/openvino/test_modeling.py

Line 1025 in a666ac6

SUPPORTED_ARCHITECTURES = (

and

optimum-intel/tests/openvino/test_modeling.py

Line 1180 in a666ac6

SUPPORTED_ARCHITECTURES = (

instead

Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>

popovaan

Please add tests which check inference results comparing with transformers and add quantization tests.

popovaan · 2025-12-17T10:49:43Z

Please update docs/source/openvino/models.mdx

add support for dinov3

c6b768c

openvino-dev-samples changed the title ~~[OpenVINO][Dratf]add support for dinov3~~ [OpenVINO][Draft]add support for dinov3 Aug 21, 2025

echarlaix reviewed Aug 22, 2025

View reviewed changes

openvino-dev-samples added 2 commits September 10, 2025 01:26

update dinov3 test case

912f624

update dinov3 test case

b86eae5

rkazants suggested changes Sep 15, 2025

View reviewed changes

echarlaix reviewed Sep 19, 2025

View reviewed changes

openvino-dev-samples and others added 5 commits September 23, 2025 10:57

Update tests/openvino/utils_tests.py

2488694

Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>

Update optimum/exporters/openvino/model_configs.py

b6c8e88

Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>

Update optimum/exporters/openvino/model_configs.py

6d8a932

Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>

Update optimum/exporters/openvino/model_configs.py

4f8eaa5

Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>

rebase

e8c9238

echarlaix reviewed Sep 29, 2025

View reviewed changes

optimum/exporters/openvino/model_configs.py Outdated Show resolved Hide resolved

echarlaix reviewed Sep 29, 2025

View reviewed changes

solve conflict

7b1043f

openvino-dev-samples force-pushed the dinov3 branch from 6a10e59 to 7b1043f Compare October 16, 2025 04:12

echarlaix added 2 commits December 2, 2025 15:45

merge main

9e4c47c

set min transformers version to v4.56

8d99bf5

fix style

bd74200

echarlaix reviewed Dec 2, 2025

View reviewed changes

openvino-dev-samples and others added 2 commits December 3, 2025 10:24

Update optimum/exporters/openvino/model_configs.py

0624368

Co-authored-by: Ella Charlaix <80481427+echarlaix@users.noreply.github.com>

add missing import

29ac707

rkazants requested a review from popovaan December 15, 2025 19:18

popovaan suggested changes Dec 17, 2025

View reviewed changes

openvino-dev-samples added 2 commits December 19, 2025 08:26

update doc and test case

4d640b3

update export test

b68b718

Merge branch 'main' into dinov3

72da902

		@register_in_tasks_manager("dinov3_vit", *["feature-extraction"], library_name="transformers")
		@register_in_tasks_manager("dinov3_convnext", *["feature-extraction"], library_name="transformers")

[OpenVINO][Draft]add support for dinov3 #1431

Are you sure you want to change the base?

[OpenVINO][Draft]add support for dinov3 #1431

Uh oh!

Conversation

openvino-dev-samples commented Aug 21, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

What does this PR do?

Before submitting

Uh oh!

echarlaix left a comment

Choose a reason for hiding this comment

Uh oh!

rkazants left a comment

Choose a reason for hiding this comment

Uh oh!

echarlaix left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

echarlaix Sep 19, 2025

Choose a reason for hiding this comment

Uh oh!

echarlaix Dec 2, 2025

Choose a reason for hiding this comment

Uh oh!

openvino-dev-samples Dec 3, 2025

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

echarlaix commented Sep 19, 2025

Uh oh!

Uh oh!

echarlaix Sep 29, 2025

Choose a reason for hiding this comment

Uh oh!

echarlaix commented Dec 2, 2025

Uh oh!

HuggingFaceDocBuilderDev commented Dec 2, 2025

Uh oh!

Uh oh!

echarlaix Dec 2, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

popovaan left a comment

Choose a reason for hiding this comment

Uh oh!

popovaan commented Dec 17, 2025

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

openvino-dev-samples commented Aug 21, 2025 •

edited

Loading

echarlaix Dec 2, 2025 •

edited

Loading