Official Project Page for HLA: Higher-order Linear Attention (https://arxiv.org/abs/2510.27258)
Glycan Informed Foundational Framework for Learning Abstract Representations, based on Combinatorial Complexes and Heterogeneous GNNs
AutoMathText-V2: A 2.46 Trillion Token AI-Curated STEM Pretraining Dataset
Accessible, efficient data preprocessing library for pretrain and SFT datasets, including KL3M
Adapting a Continually Pre-Trained T5 Model on Scientific Data to German Using Cross-Lingual Transfer
Add a description, image, and links to the pretraining topic page so that developers can more easily learn about it.
To associate your repository with the pretraining topic, visit your repo's landing page and select "manage topics."