What's Changed
Breaking Changes
- Constructor of
ir.Function
now takes metadata_props from the ir.Graph object. #2182
Core ONNX Script
- Annotate
script()
withParamSpec
for more accurate typing by @justinchuby in #2178 - Replace ast.NameConstant with ast.Constant and remove duplicates by @justinchuby in #2188
Optimizer and rewriter
- Introduce pattern.any_value by @gramalingam in #2175
- [Pass] Fix bugs in LiftConstantsToInitializersPass by @titaiwangms in #2189
- [pass] Avoid lifting tensors that are too small to initializers by @justinchuby in #2190
- Avoid using fixed value for max_pos_ids in cos_sin_cache fusion by @shubhambhokare1 in #2167
- Add fusion rule to fuse (query, key, value) to a packed QKV for GQA by @shubhambhokare1 in #2174
- Update constant fold to use correct numpy type by @justinchuby in #2204
- Remove legacy optimizer by @justinchuby in #2180
- [Pass] Remove metadata_props and doc_string from the model by @titaiwangms in #2182
ONNX IR
- [Pass] Support lift constants to initializers pass by @titaiwangms in #2160
- [pass] Create topological sort pass by @justinchuby in #2191
- [pass] Create check to ensure in-place passes are actually inplace by @justinchuby in #2192
- [IR] Reconcile graph in Node by @justinchuby in #2183
- [IR] Implement
model.graphs()
by @justinchuby in #2200 - [passes] Move inliner to common passes by @justinchuby in #2206
- [passes] Remove external_data_folder option from FoldConstantsPass by @justinchuby in #2207
- [pass] Implement checker pass and refactor shape inference by @justinchuby in #2199
- [IR][fix] Save value info for initializers by @justinchuby in #1552
- [IR] Allow pass result as pass input by @justinchuby in #2220
- [pass] Create version converter pass by @justinchuby in #2214
- [pass] Remove unused initialized inputs in DCE by @leshabirukov in #2212
Torch Lib
- [torchlib] Precompute the constant for gelu to avoid precision loss by @justinchuby in #2179
- [torchlib] Fix calls to Unsqueeze to provide correct 1d axes by @justinchuby in #2186
- Implement fft torchop by @bmehta001 in #2141
Documentation
- Update onnxscript documentation page by @justinchuby in #2177
Other Changes
- Remove benchmark from tools by @justinchuby in #2173
- Modify constant-folder to return computed symbolic value map by @gramalingam in #2172
- Update ort-nightly version in test by @justinchuby in #2193
- Updated docs for rewrite-patterns by @LuniaKunal in #2196
- Add test for TopologicalSortPass on functions by @justinchuby in #2198
- Update TorchTensor to use ml_dtypes by @justinchuby in #2201
- Update release.yml to change the section for passes by @justinchuby in #2208
- Fix optimizer tests by @justinchuby in #2217
New Contributors
- @LuniaKunal made their first contribution in #2196
- @bmehta001 made their first contribution in #2141
Full Changelog: v0.2.4...v0.2.5