Implementation of Flash Attention in Jax
-
Updated
Mar 1, 2024 - Python
#
long-context-attention
Here are 7 public repositories matching this topic...
Implementation of Block Recurrent Transformer - Pytorch
deep-learning memory artificial-intelligence recurrence attention-mechanisms long-context-attention long-context-transformers
-
Updated
Aug 20, 2024 - Python
[ICLR 2025] TidalDecode: A Fast and Accurate LLM Decoding with Position Persistent Sparse Attention
-
Updated
Aug 6, 2025 - Python
RAN: Recurrent Attention Networks for Long-text Modeling | Findings of ACL23
acl recurrent-networks long-context long-context-attention acl2023 long-context-transformers long-document-modeling recurrent-attention-networks
-
Updated
Aug 12, 2023 - Python
Official code for the NeurIPS25 paper "RAT: Bridging RNN Efficiencyand Attention Accuracy in Language Modeling" (https://arxiv.org/abs/2507.04416))
-
Updated
Jul 18, 2025 - Python
A custom attention framework aimed at maximum context, speed and usability. Featured with a triton kernel, and a couple of benchmarks.
-
Updated
Nov 9, 2025 - Python
A repository to get train transformers to access longer context for causal language models, most of these methods are still in testing. Try them out if you'd like but please lmk your results so we don't duplicate work :)
-
Updated
Jul 6, 2023 - Python
Improve this page
Add a description, image, and links to the long-context-attention topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the long-context-attention topic, visit your repo's landing page and select "manage topics."