Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

ONNX Add regression test #1530

Merged
merged 29 commits into from
Feb 14, 2023
Merged

ONNX Add regression test #1530

Changes from 1 commit
Commits
Show all changes
29 commits
Select commit Hold shift + click to select a range
fc54446
Add mobielenet_v2 reg test
kshpv Jan 26, 2023
567a42f
Small refactor
kshpv Jan 26, 2023
c44ef65
Fix bug; Change onnxrt to onnxrt-ov
kshpv Jan 26, 2023
33d6c73
Update test criteria
kshpv Jan 26, 2023
bf8a4f9
update based on liubov PR
kshpv Jan 27, 2023
c645649
Update test
kshpv Jan 30, 2023
869e0b3
Add model; Update requirments
kshpv Jan 30, 2023
2498286
Update model
kshpv Jan 30, 2023
84e409c
Add efficientnet-lite4-11; Change inference backend to OV
kshpv Jan 31, 2023
9f14e47
Update criteria
kshpv Jan 31, 2023
4ecb3d6
Pylint; Reference
kshpv Feb 1, 2023
04900b5
Fix bug in async mode
kshpv Feb 1, 2023
607830f
Reference
kshpv Feb 1, 2023
f857a8e
fix bug
kshpv Feb 1, 2023
4516cc7
Update async calulcations
kshpv Feb 1, 2023
80b8c0e
Fix memory leaks
kshpv Feb 1, 2023
1b6ece3
Update compile model method
kshpv Feb 2, 2023
987ab7d
Update reqs
kshpv Feb 3, 2023
5e8cd98
Relax criteria
kshpv Feb 3, 2023
fe4a8ff
Fix header
kshpv Feb 3, 2023
e70a465
Add data-dit to test
kshpv Feb 3, 2023
5659c84
Add data param to test
kshpv Feb 3, 2023
3eb9b3e
Fix typo changes
kshpv Feb 3, 2023
71707a3
Update req for ONNX sample
kshpv Feb 3, 2023
bbee4a5
Pylint fix
kshpv Feb 6, 2023
614fd22
Fix bug
kshpv Feb 6, 2023
17ec223
Apply comments; Move from regression dir to quantization dir
kshpv Feb 7, 2023
46a02eb
Add model_dir for test
kshpv Feb 8, 2023
a1b67b8
Merge --model-dir into --data
kshpv Feb 13, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Relax criteria
  • Loading branch information
@kshpv
kshpv committed Feb 3, 2023
commit 5e8cd98fd2cbd23e607b2a9bef6a53dd9b23f67f
2 changes: 1 addition & 1 deletion tests/onnx/quantization/regression_test/test_ptq_regression.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -126,4 +126,4 @@ def transform_fn(data_item):
onnx.save_model(quantized_model, str(int8_model_path))
int8_top1 = validate(int8_model_path, val_loader)
print(f'INT8 metrics = {int8_top1}')
assert abs(int8_top1 - int8_ref_top1) < 1e-6 # 0.01 deviations
assert abs(int8_top1 - int8_ref_top1) < 3e-3 # 0.03 deviations