Skip to content

✨[Feature] Allow "pass-through" of engine-build errors in Dynamo #1927

Closed
@gs-olive

Description

@gs-olive

Currently, engine build errors in the torch_tensorrt.dynamo.torch_compile path are handled by returning graph.forward for that subgraph (effectively falling back to Torch). The interface should provide the option to users to instead halt the compilation entirely when a TRT Engine build fails. Additionally, if the user prefers to continue compilation in the event of an engine build failure, the error should be relayed via logging.error.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions