New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

ONNX Add regression test #1530

Merged

alexsu52 merged 29 commits into openvinotoolkit:develop from kshpv:onnx_reg_test

Feb 14, 2023

Collaborator

kshpv commented Jan 26, 2023 •

edited

Loading

Changes

Add regression test for three ONNX Model ZOO models: mobilenet_v2, resnet50, efficientnet-lite4.
Update test requirements.txt
Change onnxruntime to onnxruntime-openvino in ONNX sample to measure the final accuracy in INT8 inference

Reason for changes

To test the regressions in algorithms

Related tickets

96257

Tests

Test added

kshpv added 2 commits

January 26, 2023 11:48


          Add mobielenet_v2 reg test

fc54446


          Small refactor

567a42f

github-actions bot added the NNCF ONNX label

kshpv added 6 commits

January 26, 2023 13:32


          Fix bug; Change onnxrt to onnxrt-ov

c44ef65


          Update test criteria

33d6c73


          update based on liubov PR

bf8a4f9


          Update test

c645649


          Add model; Update requirments

869e0b3


          Update model

Collaborator Author

kshpv commented Jan 30, 2023

run onnx pre-commit tests

1 similar comment

Collaborator Author

kshpv commented Jan 31, 2023

run onnx pre-commit tests


          Add efficientnet-lite4-11; Change inference backend to OV

84e409c

kshpv changed the title ~~ONNX Add regression test based on sample~~ ONNX Add regression test

kshpv requested review from nikita-malininn, alexsu52, andrey-churkin and l-bat

January 31, 2023 14:54

kshpv added 2 commits

January 31, 2023 17:30


          Update criteria

9f14e47


          Pylint; Reference

4ecb3d6

Collaborator Author

kshpv commented Feb 1, 2023

run onnx pre-commit tests

alexsu52 reviewed

View reviewed changes

tests/onnx/quantization/regression_test/test_ptq_regression.py Outdated Show resolved Hide resolved

kshpv added 4 commits

February 1, 2023 14:32


          Fix bug in async mode

04900b5


          Reference

607830f


          fix bug

f857a8e


          Update async calulcations

4516cc7

Collaborator Author

kshpv commented Feb 1, 2023

run onnx pre-commit tests


          Fix memory leaks

80b8c0e

nikita-malininn reviewed

View reviewed changes

examples/post_training_quantization/onnx/mobilenet_v2/requirements.txt Outdated Show resolved Hide resolved

nikita-malininn reviewed

View reviewed changes

tests/onnx/quantization/regression_test/test_ptq_regression.py Outdated Show resolved Hide resolved

nikita-malininn reviewed

View reviewed changes

tests/onnx/quantization/regression_test/test_ptq_regression.py Outdated Show resolved Hide resolved


          Add data-dit to test

e70a465

kshpv marked this pull request as ready for review

February 3, 2023 14:22

kshpv added 3 commits

February 3, 2023 15:55


          Add data param to test

5659c84


          Fix typo changes

3eb9b3e


          Update req for ONNX sample

71707a3

github-actions bot removed the NNCF OpenVINO label

kshpv added 2 commits

February 6, 2023 11:44


          Pylint fix

bbee4a5


          Fix bug

614fd22

kshpv requested review from alexsu52 and nikita-malininn

February 6, 2023 13:56

nikita-malininn approved these changes

View reviewed changes

alexsu52 reviewed

View reviewed changes

Contributor

alexsu52 left a comment

Please, add the license into new files.

tests/onnx/quantization/regression_test/test_ptq_regression.py Outdated Show resolved Hide resolved


          Apply comments; Move from regression dir to quantization dir

17ec223

Collaborator Author

kshpv commented Feb 7, 2023

run tensorflow pre-commit tests

2 similar comments

Collaborator Author

kshpv commented Feb 7, 2023

run tensorflow pre-commit tests

Collaborator Author

kshpv commented Feb 7, 2023

run tensorflow pre-commit tests

kshpv requested a review from alexsu52

February 7, 2023 15:18

l-bat approved these changes

View reviewed changes


          Add model_dir for test

46a02eb

Collaborator Author

kshpv commented Feb 8, 2023

@alexsu52, I 've added model_dir param in test. Changes in ONNX precommit will be applied after merging this PR.

Collaborator Author

kshpv commented Feb 9, 2023

run torch pre-commit tests

Collaborator Author

kshpv commented Feb 9, 2023

run tensorflow pre-commit tests

1 similar comment

Collaborator Author

kshpv commented Feb 9, 2023

run tensorflow pre-commit tests

Collaborator Author

kshpv commented Feb 9, 2023

run torch pre-commit tests

Collaborator Author

kshpv commented Feb 9, 2023

run pytorch pre-commit tests

Collaborator Author

kshpv commented Feb 9, 2023

run onnx pre-commit tests


          Merge --model-dir into --data

a1b67b8

alexsu52 approved these changes

View reviewed changes

alexsu52 merged commit 55ba71f into openvinotoolkit:develop

kshpv deleted the onnx_reg_test branch

January 17, 2024 17:36

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels