torch settings

[eas125]

Curious if these are the correct settings for running torch.compile. The only thing I have different from default is dynamic=true.

[kijai]

The default is fine, most compatible and fastest to compile, everything else is minimal benefit for longer compile times, and may not even work or requires further setup. Dynamic should not be needed either, compiling only the transformer blocks is really fast and recompilation times are hardly an issue.

[jepjoo]

What does dynamic do anyways?