zerotohero

My implementation of modules from Andrej Karapathy's Zero to Hero course

File descriptions:

names_bigrams.ipynb: The first module: simple bigram character model that learns to generate names. Minimal usage of Pytorch APIs.
names_ngrams*.ipynb: Multiple experiments with n-grams model. Changes to param initialization (e.g. kaiming init, zero init) as well as batch normalization. Minimal usage of pytorch APIs.
nn_test.ipynb: simple tutorial from pytorch for using pytorch APIs.
pytorch-api-name-ngram-batchnorm.ipynb: ngram model that uses Pytorch APIs.
wavenet-name-ngrams.ipynb: wavenet implementation of name generator.
transformer.ipynb: The final module: transformer in pytorch that implements a character level language model. Given a dataset of shakespeare texts can generate shakespeare-like language.

Name		Name	Last commit message	Last commit date
Latest commit History 14 Commits
.gitignore		.gitignore
README.md		README.md
names.txt		names.txt
names_bigrams.ipynb		names_bigrams.ipynb
names_ngrams-zero-init.ipynb		names_ngrams-zero-init.ipynb
names_ngrams.ipynb		names_ngrams.ipynb
names_ngrams_batchnorm-zero-init.ipynb		names_ngrams_batchnorm-zero-init.ipynb
names_ngrams_batchnorm.ipynb		names_ngrams_batchnorm.ipynb
nn_test.ipynb		nn_test.ipynb
pytorch-api-name-ngram-batchnorm.ipynb		pytorch-api-name-ngram-batchnorm.ipynb
shakespeare.txt		shakespeare.txt
transformer.ipynb		transformer.ipynb
wavenet-name-ngrams.ipynb		wavenet-name-ngrams.ipynb

Provide feedback