update_NLP_syllabus

README.md

@@ -39,9 +39,9 @@ Aug 17 | <ul>**Git WorkFlow**</ul><li>[Git (Blake)](https://paper.dropbox.com/do
 Aug 19 | <ul>**CV Course1**</ul><li>Image Data Augmentation (Blake)</li><li>Torchvision.transforms, Imgaug </li><ul>**CV Course2**</ul><li>Classic CNN Structures (Blake)</li><li>Advanced CNN Structures - Part1</li><li>InceptionV1-V4</li><li>ResNetV1-V2</li>|
 Aug 24 | <ul>**CV Course3**</ul>**Advanced CNN Structures - Part2**<li>DenseNet  (Jeff)</li><li>ShuffleNet</li><li>SENet</li><li>MobileNetV1-V3</li><li>EfficientNetV1-V2</li><li>NFNet</li><li>GhostNet</li><ul>**CV Course4**</ul><li>Loss function - Select & Design (Jeff)</li> |
 Aug 26 |<ul>**CV Course5**</ul>**Bag of training tricks (Jeff)**<li>[Stochastic Depth](https://arxiv.org/abs/1603.09382)<li>[Warm up](https://arxiv.org/abs/1512.03385)</li><li>[Label Smoothing](https://arxiv.org/abs/1906.02629)</li><li>[No Bias Weight Decay](https://arxiv.org/abs/1807.11205)</li><li>[Teacher-Student Knowledge Distillation](https://arxiv.org/abs/1503.02531)</li><li>[Mixup](https://arxiv.org/abs/1710.09412)</li><li>[Group Normalization](https://arxiv.org/abs/1803.08494)</li><li>[Weight Standardization](https://arxiv.org/abs/1903.10520)</li><ul>**CV Course6**</ul>**Hands On - Build and Serve OCR engine**<li>[OCR-Captcha-Cracker](https://github.com/jeff52415/OCR-Captcha-Cracker)</li>| 
-Aug 31 |  |
-Sep 2 |  |
-Sep 7 |  |
+Aug 31 | <ul>**NLP Technical Class [1]**</ul>[**Missions & Metrics (Dini)**](https://docs.google.com/presentation/d/1xsv8n2JPu3YS6biDYnBZ1mxQo4yZyIptZnqEvLEWo_s/edit?usp=sharing)<li>Tasks of NLP</li><li>Common Metrics of NLP</li><ul>**NLP Technical Class [2]**</ul>[**Preprocessing (Dini)**](https://docs.google.com/presentation/d/1y1gs_y_YbGYPAXPGEKCMThzCuJEdIiDwFbPqYWr7_JQ/edit?usp=sharing)<li>Removing</li><li>Normalizing</li><li>Tokenize</li> |
+Sep 2 | <ul>**NLP Technical Class [3]**</ul>[**Pre-training I (Tsung-Wei)**](https://github.com/Cinnamon/2021TWBootcamp/tree/main/natural_language_processing/pre-train%20I)<li>Embedding definition</li><li>One-hot enocding</li><li>TF-IDF</li><li>N-gram</li><li>Word2Vec</li><li>Glove</li> |
+Sep 7 | <ul>**NLP Technical Class [4]**</ul>[**Pre-training II (Ian)**]()<li>Language models</li><li>Transformer</li><li>BERT: pre-training and fine-tuning</li> |
 Sep 9 | <ul>**CV Course7**</ul>**Vision transformer & Evolution (Jeff)**<li>DeiT, ViT </li><li>CaiT</li><li>VOVO</li><ul>**Appendix A**</ul><li>Research Review Flow (Dini)</li>|
 Sep 14 | **Pitching**<li>[Presentation](https://docs.google.com/presentation/d/1gfDYN5-RllJ33KLRo_GM8wRylgQ5dlHfMeFq02RKXEU/edit?usp=sharing) (Paul)</li>|
 Sep 16 | **Pre-Rehearsal** |