Question re. ANE Usage with Flexible Input Shapes #1764
Labels
Core ML Framework
An issue related to the Core ML Framework
question
Response providing clarification needed. Will not be assigned to a release. (type)
❓Question
Not sure if this is a framework issue, or one with
coremltools
. My hunch is the latter, so I'm asking here.I've exported a model that requires a flexible input shape, and set the default shape to
1
. This model doesn't use the ANE at all, and only runs on CPU.Out of curiosity, I set the input shape to be fixed to
1
to see if the model would run faster. This model uses the GPU / ANE and is significantly faster. Does this mean that ANE usage is out of the window with flexible input shapes, or is there scope to redefine the model to allow it to use the ANE with flexible shapes too?Unfortunately, I cannot share the model definition publicly.
Fixed input shape:
Flexible input shape:
The text was updated successfully, but these errors were encountered: