Skip to content

My own attempt at implementing Language Models like GPT from scratch.

Notifications You must be signed in to change notification settings

inner-LMNt/Self-GPT

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Self GPT

File Structure

Self-GPT/
│
├── data/
|   ├── processed/
│   ├── raw/
│   ├── samples/
|   ├── __init__.py
│   ├── preprocess.py
|   └── tokenizer.py
|
├── models/
│   ├── checkpoints/
|   |   ├── bigram/
|   |   └── trigram/
|   |
│   ├── LLM/
│   │   ├── __init__.py
|   |   ├── attention.py
|   |   ├── bigram.py
│   │   ├── config.py
│   │   ├── GPT.py
│   │   └── trigram.py
│   └── utils.py
|
├── notebooks/
|   └── training.ipynb
|
├── .gitignore
├── evaluation.py
├── inference.py
├── README.md
├── requirements.txt
└── training.py

About

My own attempt at implementing Language Models like GPT from scratch.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published