diff --git a/README.md b/README.md index 7a00cbf..dbffd9d 100644 --- a/README.md +++ b/README.md @@ -39,9 +39,9 @@ Aug 17 |
  • [Git (Blake)](https://paper.dropbox.com/do Aug 19 |
  • Image Data Augmentation (Blake)
  • Torchvision.transforms, Imgaug
  • Classic CNN Structures (Blake)
  • Advanced CNN Structures - Part1
  • InceptionV1-V4
  • ResNetV1-V2
  • | Aug 24 | **Advanced CNN Structures - Part2**
  • DenseNet (Jeff)
  • ShuffleNet
  • SENet
  • MobileNetV1-V3
  • EfficientNetV1-V2
  • NFNet
  • GhostNet
  • Loss function - Select & Design (Jeff)
  • | Aug 26 |**Bag of training tricks (Jeff)**
  • [Stochastic Depth](https://arxiv.org/abs/1603.09382)
  • [Warm up](https://arxiv.org/abs/1512.03385)
  • [Label Smoothing](https://arxiv.org/abs/1906.02629)
  • [No Bias Weight Decay](https://arxiv.org/abs/1807.11205)
  • [Teacher-Student Knowledge Distillation](https://arxiv.org/abs/1503.02531)
  • [Mixup](https://arxiv.org/abs/1710.09412)
  • [Group Normalization](https://arxiv.org/abs/1803.08494)
  • [Weight Standardization](https://arxiv.org/abs/1903.10520)
  • **Hands On - Build and Serve OCR engine**
  • [OCR-Captcha-Cracker](https://github.com/jeff52415/OCR-Captcha-Cracker)
  • | -Aug 31 | | -Sep 2 | | -Sep 7 | | +Aug 31 | [**Missions & Metrics (Dini)**](https://docs.google.com/presentation/d/1xsv8n2JPu3YS6biDYnBZ1mxQo4yZyIptZnqEvLEWo_s/edit?usp=sharing)
  • Tasks of NLP
  • Common Metrics of NLP
  • [**Preprocessing (Dini)**](https://docs.google.com/presentation/d/1y1gs_y_YbGYPAXPGEKCMThzCuJEdIiDwFbPqYWr7_JQ/edit?usp=sharing)
  • Removing
  • Normalizing
  • Tokenize
  • | +Sep 2 | [**Pre-training I (Tsung-Wei)**](https://github.com/Cinnamon/2021TWBootcamp/tree/main/natural_language_processing/pre-train%20I)
  • Embedding definition
  • One-hot enocding
  • TF-IDF
  • N-gram
  • Word2Vec
  • Glove
  • | +Sep 7 | [**Pre-training II (Ian)**]()
  • Language models
  • Transformer
  • BERT: pre-training and fine-tuning
  • | Sep 9 | **Vision transformer & Evolution (Jeff)**
  • DeiT, ViT
  • CaiT
  • VOVO
  • Research Review Flow (Dini)
  • | Sep 14 | **Pitching**
  • [Presentation](https://docs.google.com/presentation/d/1gfDYN5-RllJ33KLRo_GM8wRylgQ5dlHfMeFq02RKXEU/edit?usp=sharing) (Paul)
  • | Sep 16 | **Pre-Rehearsal** |