Skip to content

Commit ab293f8

Browse files
decahedron1decahedron1
committed
chore: update to ONNX Runtime v1.19.0
1 parent e2c4549 commit ab293f8

File tree

8 files changed

+60
-40
lines changed

8 files changed

+60
-40
lines changed

‎README.md

+2-2
Original file line numberDiff line numberDiff line change
@@ -3,10 +3,10 @@
33
<hr />
44
<a href="https://app.codecov.io/gh/pykeio/ort" target="_blank"><img alt="Coverage Results" src="https://img.shields.io/codecov/c/gh/pykeio/ort?style=for-the-badge"></a> <a href="https://crates.io/crates/ort" target="_blank"><img alt="Crates.io" src="https://img.shields.io/crates/d/ort?style=for-the-badge"></a> <a href="https://opencollective.com/pyke-osai" target="_blank"><img alt="Open Collective backers and sponsors" src="https://img.shields.io/opencollective/all/pyke-osai?style=for-the-badge&label=sponsors"></a>
55
<br />
6-
<a href="https://crates.io/crates/ort" target="_blank"><img alt="Crates.io" src="https://img.shields.io/crates/v/ort?style=for-the-badge&label=ort&logo=rust"></a> <img alt="ONNX Runtime" src="https://img.shields.io/badge/onnxruntime-v1.18.1-blue?style=for-the-badge&logo=cplusplus">
6+
<a href="https://crates.io/crates/ort" target="_blank"><img alt="Crates.io" src="https://img.shields.io/crates/v/ort?style=for-the-badge&label=ort&logo=rust"></a> <img alt="ONNX Runtime" src="https://img.shields.io/badge/onnxruntime-v1.19.0-blue?style=for-the-badge&logo=cplusplus">
77
</div>
88

9-
`ort` is an (unofficial) [ONNX Runtime](https://onnxruntime.ai/) 1.18 wrapper for Rust based on the now inactive [`onnxruntime-rs`](https://github.com/nbigaouette/onnxruntime-rs). ONNX Runtime accelerates ML inference and training on both CPU & GPU.
9+
`ort` is an (unofficial) [ONNX Runtime](https://onnxruntime.ai/) 1.19 wrapper for Rust based on the now inactive [`onnxruntime-rs`](https://github.com/nbigaouette/onnxruntime-rs). ONNX Runtime accelerates ML inference and training on both CPU & GPU.
1010

1111
## 📖 Documentation
1212
- [Guide](https://ort.pyke.io/)

‎docs/pages/migrating/version-mapping.mdx

+2-2
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,7 @@ description: Information about `ort`'s versioning and relation to ONNX Runtime v
66
## A note on SemVer
77
`ort` versions pre-2.0 were not SemVer compatible. From v2.0 onwards, breaking API changes are accompanied by a **major version update**.
88

9-
Updates to the version of ONNX Runtime used by `ort` may occur on **minor** version updates, i.e. 2.0 ships with ONNX Runtime 1.18.1, but 2.1 may ship with 1.19.0. ONNX Runtime is generally forward compatible, but in case you require a specific version of ONNX Runtime, you should pin the minor version in your `Cargo.toml` using a [tilde requirement](https://doc.rust-lang.org/cargo/reference/specifying-dependencies.html#tilde-requirements):
9+
Updates to the version of ONNX Runtime used by `ort` may occur on **minor** version updates, i.e. 2.0 ships with ONNX Runtime 1.19.0, but 2.1 may ship with 1.20.0. ONNX Runtime is generally forward compatible, but in case you require a specific version of ONNX Runtime, you should pin the minor version in your `Cargo.toml` using a [tilde requirement](https://doc.rust-lang.org/cargo/reference/specifying-dependencies.html#tilde-requirements):
1010
```toml
1111
[dependencies]
1212
ort = { version = "~2.0", ... }
@@ -16,7 +16,7 @@ ort = { version = "~2.0", ... }
1616

1717
| **ort** | **ONNX Runtime** |
1818
| -------- | ----------------:|
19-
| v2.0.0+ | v1.18.1 |
19+
| v2.0.0+ | v1.19.0 |
2020
| v1.16.0-v1.16.2 | v1.16.0 |
2121
| v1.15.0-v1.15.5 | v1.15.1 |
2222
| v1.14.2-v1.14.8 | v1.14.1 |

‎ort-sys/build.rs

+1-1
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,7 @@ use std::{
55
};
66

77
#[allow(unused)]
8-
const ONNXRUNTIME_VERSION: &str = "1.18.1";
8+
const ONNXRUNTIME_VERSION: &str = "1.19.0";
99

1010
const ORT_ENV_SYSTEM_LIB_LOCATION: &str = "ORT_LIB_LOCATION";
1111
const ORT_ENV_SYSTEM_LIB_PROFILE: &str = "ORT_LIB_PROFILE";

‎ort-sys/dist.txt

+24-28
Original file line numberDiff line numberDiff line change
@@ -1,34 +1,30 @@
1-
none aarch64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static-v1.18.1-aarch64-unknown-linux-gnu.tgz 221BFD9E8D0D5B31A3E7DD5290EAB8D677B31221DAC0DD2AD8D63DF216D411D8
2-
cu12 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_cu12-v1.18.1-x86_64-unknown-linux-gnu.tgz 74F4EC918F00B6517BC71AA23DEA0E0809694D5FAB10A494A7AE571F06AEA0BD
3-
cu11 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_cu11-v1.18.1-x86_64-unknown-linux-gnu.tgz 8DFD96ABB8AAE7F66DD415BCA65E9EE98033E11D3FDB2A178F31E8B1B61C1FD9
4-
rocm x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_rocm-v1.18.1-x86_64-unknown-linux-gnu.tgz 84F74428E0BEC68C55B8E1E91B9282E984CD2866148A2584382B8CB3284214A3
5-
none x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static-v1.18.1-x86_64-unknown-linux-gnu.tgz 0A193706A95286853D792D7D9B2271CBEA35C57F249943FE811CED97E0E24862
1+
none aarch64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static-v1.19.0-aarch64-unknown-linux-gnu.tgz 16E1C77635667D7BA4665AB90BD3C7561D83EC06C9A39005408331664AA6C6EE
2+
cu12 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_cu12-v1.19.0-x86_64-unknown-linux-gnu.tgz 2F61B83D97938F1F69061A87F7FC54FA2A46BB436914C462C6A250FAC6825557
3+
cu11 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_cu11-v1.19.0-x86_64-unknown-linux-gnu.tgz CCEDAF29409C7B7FE95867E7407AEFAE190713431F2E4CB70392AD4B6F623314
4+
none x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static-v1.19.0-x86_64-unknown-linux-gnu.tgz 61DE32431DD7A4830CB5C5A014533419D0947AB0321E31D054DDA218B1FF0D49
65

7-
train aarch64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static_train-v1.18.1-aarch64-unknown-linux-gnu.tgz C04DBEAF19F2BCD3643F8F7D7FA01110A1AF429DFDD1C1DC7C5EDA2B1A8AA324
8-
train,cu12 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_train,cu12-v1.18.1-x86_64-unknown-linux-gnu.tgz A139D8AD8930930F5A61DF112C8275AAD1F0415FAFD08CE3031CEFFFC30F2445
9-
train,cu11 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_train,cu11-v1.18.1-x86_64-unknown-linux-gnu.tgz 2DAA2E2CF44E9B9A96AB2E9C4271C35189C96BF264D1797DABCF1D6711730DE7
10-
train,rocm x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_train,rocm-v1.18.1-x86_64-unknown-linux-gnu.tgz DD373BA6B251D21953223B2FBB64F4DF34CFE98A63C26D16607BEAC6BC788466
11-
train x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static_train-v1.18.1-x86_64-unknown-linux-gnu.tgz 0E617970AE83ABE5FB9A3D5D69AAC9A67ED4C9494AD527B14A84FDC98CA9B924
6+
train aarch64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static_train-v1.19.0-aarch64-unknown-linux-gnu.tgz F50640F57FFE4B4029841A9A64B8C371AAA415DC4ECCFF35392B09B208C9C562
7+
train,cu12 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_train,cu12-v1.19.0-x86_64-unknown-linux-gnu.tgz 4F0BA9642311F6C59B91ABB3AE6F5467F81F745A8F99299AC2954D885622EBB4
8+
train,cu11 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_train,cu11-v1.19.0-x86_64-unknown-linux-gnu.tgz 6C442E5EAEA9772B67B7D3AFC8A6C71BE0CF65E3FF4DD9DDE5C8260E77DFEBCC
9+
train x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static_train-v1.19.0-x86_64-unknown-linux-gnu.tgz D6CE12D8CFFBC63AC9A1131AE65088F70A7C9F34EB96060B1187157E25B91D0E
1210

13-
none aarch64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static-v1.18.1-aarch64-pc-windows-msvc.tgz B2F962F0E75F17F3D657B3504CE891BAA6461B26AF65FBD9244B3CCA17FD79D4
14-
cu12 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_cu12-v1.18.1-x86_64-pc-windows-msvc.tgz CDBC2D87B202E1847900E94796D102EE4D5C19A9568BBD014838ECD1F5D5350B
15-
cu11 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_cu11-v1.18.1-x86_64-pc-windows-msvc.tgz B514FC25453F955F8592100448B27F5E1762A344E8C2D57D41B908978EF2A126
16-
none x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static-v1.18.1-x86_64-pc-windows-msvc.tgz EB2BCD1778C5934437D4C5B17F67DEAF5F67D2E3C18C7298973EACD41113DC01
11+
none aarch64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static-v1.19.0-aarch64-pc-windows-msvc.tgz 73010BEBD06B49768E2EE8279343D5E1E1F6885E95A71F4BBC6C03A03188FECA
12+
cu12 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_cu12-v1.19.0-x86_64-pc-windows-msvc.tgz 6010EFFE21C8BF2379D9D2065FD5B482FB592BBFBE06A21EFDFDA55CE97878C7
13+
cu11 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_cu11-v1.19.0-x86_64-pc-windows-msvc.tgz FCCFCEBC6B33F781190B72CA74567D686671E1AD177CEE772642289C8B873A1E
14+
none x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static-v1.19.0-x86_64-pc-windows-msvc.tgz DDBCE85B5D727D3F69A29F97F8D24B2C9F3545DE76B6C4C07AE55CC38EAE5892
1715

18-
train aarch64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static_train-v1.18.1-aarch64-pc-windows-msvc.tgz 8CC1FFFD8AB5E526A076C29A767A650C436E31179D0C6E52C2EA936067B72566
19-
train,cu12 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_train,cu12-v1.18.1-x86_64-pc-windows-msvc.tgz 6AF64567E25B59AD1196D4953EF8C6A65795E8A4B864E10D8303A027AC50B2D0
20-
train,cu11 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_train,cu11-v1.18.1-x86_64-pc-windows-msvc.tgz E14AA0F4FBBBCAF925AD4DB4F76B06402F654B36C5F221E00010D1005F47AE56
21-
train x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static_train-v1.18.1-x86_64-pc-windows-msvc.tgz 84728438E5A950027EBBDC51463F4E5B99B4979087F0F127EA18BC604507E979
16+
train aarch64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static_train-v1.19.0-aarch64-pc-windows-msvc.tgz 2E969D810A4A8D5B352091CC98A82314B70938E298B1B7E100B10B77DBAFF313
17+
train,cu12 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_train,cu12-v1.19.0-x86_64-pc-windows-msvc.tgz 1D045625D5BE0FEFE0C756CF94FFB14B766A0149AF8D69AAFBA51E191E6A63F1
18+
train,cu11 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_train,cu11-v1.19.0-x86_64-pc-windows-msvc.tgz ACE8F9D22E0916422F9F766DD57C91E3BB5D34A3B1ED4C01738D1D9D8A0C3B20
19+
train x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static_train-v1.19.0-x86_64-pc-windows-msvc.tgz 92F2B3FF013F818564ABD8B2D361474526157540E1AECE22D38D2D76186A717D
2220

23-
none aarch64-apple-darwin https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static-v1.18.1-aarch64-apple-darwin.tgz B42BE76AFB9495983A6D5D498D56D5E685B018F1011EF4C5B8C56124B192FD37
24-
none x86_64-apple-darwin https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static-v1.18.1-x86_64-apple-darwin.tgz 247F73A5B3665A6660DFB35213E6FEAAC6ED6CAC5816DD85A348DF790F60A30B
21+
none aarch64-apple-darwin https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static-v1.19.0-aarch64-apple-darwin.tgz 99DBB6CB0AF4653122B568DE558898AACD583A12EC6FA1263218A8081F919959
22+
none x86_64-apple-darwin https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static-v1.19.0-x86_64-apple-darwin.tgz F8745301FF003608D39B11C4B658E986DCF1A1B6945CCC5498D35D6C0C964360
2523

26-
train aarch64-apple-darwin https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static_train-v1.18.1-aarch64-apple-darwin.tgz 29DC09AFA5C3619CF3125F3D55DD64E5EE64451D6BD0044527776849AADEE344
27-
train x86_64-apple-darwin https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_static_train-v1.18.1-x86_64-apple-darwin.tgz 898EC9E3F852843ECDB618CF8E317F4C92BDEB33FC773038960857BCB37CB347
24+
train aarch64-apple-darwin https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static_train-v1.19.0-aarch64-apple-darwin.tgz 4F54F5EAC1F5021DE75F5E7E08040EC7C268AB4CC4587CBA851F639843222F8F
25+
train x86_64-apple-darwin https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_static_train-v1.19.0-x86_64-apple-darwin.tgz 5519D757AB9456D235672ACAAE49CDEDD94D3083354F20A482C0B0A2C7C23FE4
2826

29-
none wasm32-unknown-unknown https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-pkort_static-v1.18.1-wasm32-unknown-unknown.tgz D1BF756F02A53C3BC254E3C2048BE617082905A89182A6B1BD18C229920228EF
30-
31-
train,cu12+cudnn8 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_train,cu12+cudnn8-v1.18.1-x86_64-pc-windows-msvc.tgz 52F02DBF276409DC49533373DE89B17FDE0CCB31F9974CCF31F250DC51258971
32-
train,cu12+cudnn8 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_train,cu12+cudnn8-v1.18.1-x86_64-unknown-linux-gnu.tgz EE0580CA961CE512ECF7C1087FB081E74C780A494EAC95596CEF1089AB573242
33-
cu12+cudnn8 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_cu12+cudnn8-v1.18.1-x86_64-unknown-linux-gnu.tgz F8D72E825F744A7A7BF2036591CBE6D1F30352DBE108BEEAD1745BD571566819
34-
cu12+cudnn8 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.18.1/ortrs-msort_dylib_cu12+cudnn8-v1.18.1-x86_64-pc-windows-msvc.tgz D41121A6489B52EB7AF9614D7924AE984F4F10BF49F15E0C4FC2655649A978ED
27+
train,cu12+cudnn8 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_train,cu12+cudnn8-v1.19.0-x86_64-pc-windows-msvc.tgz D87B629A6D4474E148FE0639AE84D55AD65B0C14DABACB493C842290810ADBF1
28+
train,cu12+cudnn8 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_train,cu12+cudnn8-v1.19.0-x86_64-unknown-linux-gnu.tgz 3131A56F492A7F77E6B14CCCAD6B8BDF7EA33A55281E0309E05A0FE1372D119A
29+
cu12+cudnn8 x86_64-unknown-linux-gnu https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_cu12+cudnn8-v1.19.0-x86_64-unknown-linux-gnu.tgz AA4F7AA9CB3B5DD78470D055FE376B7AEEE8132D2F7E672923652A039D0D8D2C
30+
cu12+cudnn8 x86_64-pc-windows-msvc https://parcel.pyke.io/v2/delivery/ortrs/packages/msort-binary/1.19.0/ortrs-msort_dylib_cu12+cudnn8-v1.19.0-x86_64-pc-windows-msvc.tgz FF218B62ADFE048DBA5F234C6D8EB42CD3EFAF81B6AC5C8BC5B5974A43311C2B

‎ort-sys/src/lib.rs

+9-3
Original file line numberDiff line numberDiff line change
@@ -10,7 +10,7 @@
1010
#[doc(hidden)]
1111
pub mod internal;
1212

13-
pub const ORT_API_VERSION: u32 = 18;
13+
pub const ORT_API_VERSION: u32 = 19;
1414

1515
pub use std::ffi::{c_char, c_int, c_ulong, c_ulonglong, c_ushort, c_void};
1616

@@ -80,7 +80,9 @@ pub enum ONNXTensorElementDataType {
8080
ONNX_TENSOR_ELEMENT_DATA_TYPE_FLOAT8E4M3FN = 17,
8181
ONNX_TENSOR_ELEMENT_DATA_TYPE_FLOAT8E4M3FNUZ = 18,
8282
ONNX_TENSOR_ELEMENT_DATA_TYPE_FLOAT8E5M2 = 19,
83-
ONNX_TENSOR_ELEMENT_DATA_TYPE_FLOAT8E5M2FNUZ = 20
83+
ONNX_TENSOR_ELEMENT_DATA_TYPE_FLOAT8E5M2FNUZ = 20,
84+
ONNX_TENSOR_ELEMENT_DATA_TYPE_UINT4 = 21,
85+
ONNX_TENSOR_ELEMENT_DATA_TYPE_INT4 = 22
8486
}
8587
#[repr(i32)]
8688
#[derive(Debug, Copy, Clone, Hash, PartialEq, Eq)]
@@ -722,7 +724,11 @@ pub struct OrtMIGraphXProviderOptions {
722724
pub migraphx_fp16_enable: ::std::os::raw::c_int,
723725
pub migraphx_int8_enable: ::std::os::raw::c_int,
724726
pub migraphx_use_native_calibration_table: ::std::os::raw::c_int,
725-
pub migraphx_int8_calibration_table_name: *const ::std::os::raw::c_char
727+
pub migraphx_int8_calibration_table_name: *const ::std::os::raw::c_char,
728+
pub migraphx_save_compiled_model: ::std::os::raw::c_int,
729+
pub migraphx_save_model_path: *const ::std::os::raw::c_char,
730+
pub migraphx_load_compiled_model: ::std::os::raw::c_int,
731+
pub migraphx_load_model_path: *const ::std::os::raw::c_char
726732
}
727733
#[test]
728734
fn bindgen_test_layout_OrtMIGraphXProviderOptions() {

‎src/environment.rs

+1-1
Original file line numberDiff line numberDiff line change
@@ -118,7 +118,7 @@ impl EnvironmentBuilder {
118118
/// Typically, only Windows builds of ONNX Runtime provided by Microsoft will have telemetry enabled.
119119
/// Pre-built binaries provided by pyke, or binaries compiled from source, won't have telemetry enabled.
120120
///
121-
/// The exact kind of telemetry data sent can be found [here](https://github.com/microsoft/onnxruntime/blob/v1.18.1/onnxruntime/core/platform/windows/telemetry.cc).
121+
/// The exact kind of telemetry data sent can be found [here](https://github.com/microsoft/onnxruntime/blob/v1.19.0/onnxruntime/core/platform/windows/telemetry.cc).
122122
/// Currently, this includes (but is not limited to): ONNX graph version, model producer name & version, whether or
123123
/// not FP16 is used, operator domains & versions, model graph name & custom metadata, execution provider names,
124124
/// error messages, and the total number & time of session inference runs. The ONNX Runtime team uses this data to

‎src/execution_providers/migraphx.rs

+20-2
Original file line numberDiff line numberDiff line change
@@ -12,7 +12,9 @@ pub struct MIGraphXExecutionProvider {
1212
enable_fp16: bool,
1313
enable_int8: bool,
1414
use_native_calibration_table: bool,
15-
int8_calibration_table_name: Option<CString>
15+
int8_calibration_table_name: Option<CString>,
16+
save_model_path: Option<CString>,
17+
load_model_path: Option<CString>
1618
}
1719

1820
impl MIGraphXExecutionProvider {
@@ -41,6 +43,18 @@ impl MIGraphXExecutionProvider {
4143
self
4244
}
4345

46+
#[must_use]
47+
pub fn with_save_model(mut self, path: impl AsRef<str>) -> Self {
48+
self.save_model_path = Some(CString::new(path.as_ref()).expect("invalid string"));
49+
self
50+
}
51+
52+
#[must_use]
53+
pub fn with_load_model(mut self, path: impl AsRef<str>) -> Self {
54+
self.load_model_path = Some(CString::new(path.as_ref()).expect("invalid string"));
55+
self
56+
}
57+
4458
#[must_use]
4559
pub fn build(self) -> ExecutionProviderDispatch {
4660
self.into()
@@ -75,7 +89,11 @@ impl ExecutionProvider for MIGraphXExecutionProvider {
7589
.int8_calibration_table_name
7690
.as_ref()
7791
.map(|c| c.as_ptr())
78-
.unwrap_or_else(std::ptr::null)
92+
.unwrap_or_else(std::ptr::null),
93+
migraphx_load_compiled_model: self.load_model_path.is_some().into(),
94+
migraphx_load_model_path: self.load_model_path.as_ref().map(|c| c.as_ptr()).unwrap_or_else(std::ptr::null),
95+
migraphx_save_compiled_model: self.save_model_path.is_some().into(),
96+
migraphx_save_model_path: self.save_model_path.as_ref().map(|c| c.as_ptr()).unwrap_or_else(std::ptr::null),
7997
};
8098
crate::ortsys![unsafe SessionOptionsAppendExecutionProvider_MIGraphX(session_builder.session_options_ptr.as_ptr(), &options) -> Error::ExecutionProvider];
8199
return Ok(());

‎src/memory.rs

+1-1
Original file line numberDiff line numberDiff line change
@@ -134,7 +134,7 @@ impl Drop for Allocator {
134134
/// Represents possible devices that have their own device allocator.
135135
#[derive(Debug, Copy, Clone, PartialEq, Eq)]
136136
pub enum AllocationDevice {
137-
// https://github.com/microsoft/onnxruntime/blob/v1.18.1/include/onnxruntime/core/framework/allocator.h#L43-L53
137+
// https://github.com/microsoft/onnxruntime/blob/v1.19.0/include/onnxruntime/core/framework/allocator.h#L43-L53
138138
// ort will likely never support WebGPU, so I think it's best to leave `WebGPU_Buffer` out entirely to reduce confusion
139139
CPU,
140140
CUDA,

0 commit comments

Comments
 (0)