[KNOWN BUG] gguf + GPU AOTI Inference bug due to PT version, fix in progress #1423
Description
🐛 Describe the bug
As of #1367, torchchat/main is failing 3-5 CI jobs related to GPU AOTI inference and GGUF inference
GPU AOTI inference will be fixed with a pinbump to pytorch/pytorch#143236
GGUF AO bug is being addressed in #1404
Versions
Metadata
Metadata
Assignees
Labels
Issues related to CI infrastructure and setupIssues related to AOT Inductor and torch compileThese are known Gaps/Issues/Bug items in torchchatIssues related to Quantization or torchaoSomething isn't workingThis issue has been looked at a team member, and triaged and prioritized into an appropriate module