Skip to content

RUCKBReasoning/tilelang-sparse-attention

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

4 Commits
 
 
 
 
 
 

Repository files navigation

Tilelang Sparse Attention

This repository aim at providing a collection of Tilelang-based kernels to accelerate the training of state-of-the-art sparse attention models.

TODO

  • Deepseek-Sparse-Attention (paper)

    • warmup
    • sparse finetune
  • SeerAttention (paper)

  • MoBA/FlashMoBA (paper)

  • ...

About

No description, website, or topics provided.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published