Federated Learning for LLMs.

The official implementation of "A Language Modeling Approach to Diacritic-Free Hebrew TTS"

Kurtis is a fine-tuning, inference and evaluation tool built for SLMs (Small Language Models), such as Huggingface's SmolLM2.

This repository documents the journey of building a Small Language Model (SLM) from the ground up using Python and PyTorch. The model is a decoder-only Transformer, trained on a custom corpus of academic papers and articles focused on artificial intelligence theory.

This is a lightweight Decoder-Only language model with only 27MB of parameters, optimized for efficient text generation. It features multi-head attention, rotary embeddings, RMSNorm, and KV-cache, supporting fast inference and token generation.

Este projeto cria um chatbot local em linha de comando, utilizando o modelo quantizado (q4_0) gemma3 via Ollama. Ele oferece uma base sólida para construir interfaces conversacionais sem depender de APIs externas, ideal para aplicações locais, ambientes offline ou situações onde a privacidade dos dados é essencial.

Large language model