Skip to content

Optimize Mamba2 memory usage by replacing broadcast with einsum - #41561

Open
SohamWalam11 wants to merge 7 commits into
huggingface:mainfrom
SohamWalam11:fix-mamba2-output-discrepancy
Open

Optimize Mamba2 memory usage by replacing broadcast with einsum#41561
SohamWalam11 wants to merge 7 commits into
huggingface:mainfrom
SohamWalam11:fix-mamba2-output-discrepancy