Skip to content

fix(cuda/quantized): chunk long-prompt qmm launches to avoid gridDim>65535 and int overflow - #652

Merged
inureyes merged 1 commit into
mainfrom
fix/648-cuda-longprompt-grid-limit
Jul 6, 2026
Merged

inureyes merged 1 commit into
mainfrom
fix/648-cuda-longprompt-grid-limit

fix(cuda/quantized): chunk long-prompt qmm launches to avoid gridDim>…

42c3dbd
Select commit
Loading
Failed to load commit list.