Closed
Description
openedon Feb 24, 2024
It looks like #53219 causes some fairly extreme performance issues in inference (up to 50x longer inference times), though curiously also sometimes provides up to a 5x speed up
Originally posted by @vtjnash in #53219 (comment)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Metadata
Assignees
Labels
No labels