This repository gives a simple hands-on introduction into Bayesian Optimization for learning rate optimization. I am training a small ResNet implemented in PyTorch on the Kuzushiji-MNIST (or K-MNIST) dataset. It is only meant for educational purposes!
I have also a blog explaining everything in detail. Also, checkout the Jupyter notebook, where you'll find the results as well.
Please install all required packages.
pip install -r requirements.txt
Simply run the main script with
python main.py
Note that it was test on Python 3.8.