small-language-model

Here are 3 public repositories matching this topic...

LoserCheems / WonderfulMatrices

Wonderful Matrices to Build Small Language Models

python nlp machine-learning natural-language-processing deep-learning pytorch transformer feedforward-neural-network language-model attention-mechanism attention-is-all-you-need mixture-of-experts pytorch-transformers foundation-models small-language-models small-language-model dynamic-mask-attention cross-domain-mixture-of-experts

Updated Feb 15, 2025
Python

pittisl / Sparse-Activation

Star

Code for paper "Achieving Sparse Activation in Small Language Models"

attribution compute-efficient-ml small-language-model sparse-activation

Updated Sep 2, 2024
Python

bunyaminergen / Qwen2.5-Coder-1.5B-Instruct-Reasoning

Star

This repository provides everything you need to perform Supervised Fine-Tuning (SFT) of the Qwen2.5-Coder-1.5B-Instruct model—or any of its larger variants (7B, 14B, 32B)—on the Qwen Models, using the nvidia/OpenCodeReasoning dataset.

fine-tuning llm qwen small-language-model reasoning-language-models

Updated Apr 28, 2025
Python

Improve this page

Add a description, image, and links to the small-language-model topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the small-language-model topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly