EPCtx changes for dynamic model with reshape_input provider option #720
+10
−2
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This comment was marked as outdated.
This comment was marked as outdated.
Sorry, something went wrong.
There was a problem hiding this comment.
Pull Request Overview
This PR updates the OpenVINO backend to handle EPContext graphs dynamically by preventing dynamic backend creation and ensuring unsupported options (reshape_input) trigger an error.
- Adds a check to throw an error when the reshape_input option is provided for an EPContext graph.
- Bypasses dynamic backend creation for EPContext graphs by adding an exclusive condition to the dynamic backend selection.
Comments suppressed due to low confidence (1)
onnxruntime/core/providers/openvino/backend_manager.cc:134
- [nitpick] Consider standardizing the naming convention for EPContext. The diff uses both 'EPContext' and 'EPCtx' – please update for consistency.
// Do not create dynamic backend for EPCtx graph
gupta-pallavi
force-pushed
the
pallavig/epctx_for_partial_shapes
branch
from
3ba43da to
2487432
Compare
gupta-pallavi
force-pushed
the
pallavig/epctx_for_partial_shapes
branch
from
2487432 to
ef4adf5
Compare
1. Throw an ErrorMessage when user provide reshape_input with EPctx graph. 2. Do not Create dynamic_backend for EPctx graph. Update onnxruntime/core/providers/openvino/backend_manager.cc Co-authored-by: Copilot <175728472+Copilot@users.noreply.github.com>
gupta-pallavi
force-pushed
the
pallavig/epctx_for_partial_shapes
branch
from
ef4adf5 to
fec6e49
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
onnxruntime_perf_test.exe -e openvino -m times -r 1 -v -i "device_type|NPU" -C "ep.context_file_path| " -I C:\work\PSO2_model_ctx.onnx
Description
Motivation and Context