Skip to content

Feature(MInference): remove flash_attn dependency

2525744
Select commit
Loading
Failed to load commit list.
Merged

Feature(MInference): add triton-based decoding in case flash_attn is not available #35

Feature(MInference): remove flash_attn dependency
2525744
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs