LLM from scratch

Designing and building a Large Language Model from scratch, in progress.

Requirements

• Python 3.13
• uv

Setting up development environment

After installing uv package and project manager, run the command below to create virtual environment and install all dependencies.

uv sync

Developer Tasks Automation

This project uses Nox for implementing and running dev automation tasks such as linting, formatting code and running tests etc. Current tasks are available in noxfile.py.

Task that runs the unit tests:

uv run nox -s run_tests