Merge branch 'main' of github.com:Cinnamon/2021TWBootcamp into main

Cinnamon · Aug 25, 2021 · b3ee3ea · b3ee3ea
2 parents bfa6d0b + ce67f6b
commit b3ee3ea
Show file tree

Hide file tree

Showing 7 changed files with 3,371 additions and 21 deletions.
diff --git a/README.md b/README.md
@@ -40,7 +40,7 @@ Aug 19 | <ul>**CV Course1**</ul><li>Image Data Augmentation (Blake)</li><li>Torc
 Aug 24 | <ul>**CV Course3**</ul>**Advanced CNN Structures - Part2**<li>DenseNet  (Jeff)</li><li>ShuffleNet</li><li>SENet</li><li>MobileNetV1-V3</li><li>EfficientNetV1-V2</li><li>NFNet</li><li>GhostNet</li><ul>**CV Course4**</ul><li>Loss function - Select & Design (Jeff)</li> |
 Aug 26 |<ul>**CV Course5**</ul>**Bag of training tricks (Jeff)**<li>[Stochastic Depth](https://arxiv.org/abs/1603.09382)<li>[Warm up](https://arxiv.org/abs/1512.03385)</li><li>[Label Smoothing](https://arxiv.org/abs/1906.02629)</li><li>[No Bias Weight Decay](https://arxiv.org/abs/1807.11205)</li><li>[Teacher-Student Knowledge Distillation](https://arxiv.org/abs/1503.02531)</li><li>[Mixup](https://arxiv.org/abs/1710.09412)</li><li>[Group Normalization](https://arxiv.org/abs/1803.08494)</li><li>[Weight Standardization](https://arxiv.org/abs/1903.10520)</li><ul>**CV Course6**</ul>**Hands On - Build and Serve OCR engine**<li>[OCR-Captcha-Cracker](https://github.com/jeff52415/OCR-Captcha-Cracker)</li>| 
 Aug 31 | <ul>**NLP Technical Class [1]**</ul>[**Missions & Metrics (Dini)**](https://docs.google.com/presentation/d/1xsv8n2JPu3YS6biDYnBZ1mxQo4yZyIptZnqEvLEWo_s/edit?usp=sharing)<li>Tasks of NLP</li><li>Common Metrics of NLP</li><ul>**NLP Technical Class [2]**</ul>[**Preprocessing (Dini)**](https://docs.google.com/presentation/d/1y1gs_y_YbGYPAXPGEKCMThzCuJEdIiDwFbPqYWr7_JQ/edit?usp=sharing)<li>Removing</li><li>Normalizing</li><li>Tokenize</li> |
-Sep 2 | <ul>**NLP Technical Class [3]**</ul>[**Pre-training I (Tsung-Wei)**](https://github.com/Cinnamon/2021TWBootcamp/tree/main/natural_language_processing/pre-train%20I)<li>Embedding definition</li><li>One-hot enocding</li><li>TF-IDF</li><li>N-gram</li><li>Word2Vec</li><li>Glove</li> |
+Sep 2 | <ul>**NLP Technical Class [3]**</ul>[**Basic Encodings and Embeddings (Tsung-Wei)**](https://github.com/Cinnamon/2021TWBootcamp/tree/main/natural_language_processing/Basic%20Encodings%20and%20Embeddings)<li>Embedding definition</li><li>One-hot enocding</li><li>TF-IDF</li><li>N-gram</li><li>Word2Vec</li><li>Glove</li> |
 Sep 7 | <ul>**NLP Technical Class [4]**</ul>[**Pre-training II (Ian)**]()<li>Language models</li><li>Transformer</li><li>BERT: pre-training and fine-tuning</li> |
 Sep 9 | <ul>**CV Course7**</ul>**Vision transformer & Evolution (Jeff)**<li>DeiT, ViT </li><li>CaiT</li><li>VOVO</li><ul>**Appendix A**</ul><li>Research Review Flow (Dini)</li>|
 Sep 14 | **Pitching**<li>[Presentation](https://docs.google.com/presentation/d/1gfDYN5-RllJ33KLRo_GM8wRylgQ5dlHfMeFq02RKXEU/edit?usp=sharing) (Paul)</li>|

diff --git a/computer_vision/assets/layer_scale.png b/computer_vision/assets/layer_scale.png
diff --git a/computer_vision/slides/sota_cnn_course_3.pdf b/computer_vision/slides/sota_cnn_course_3.pdf
diff --git a/computer_vision/transformer_base_course_7.ipynb b/computer_vision/transformer_base_course_7.ipynb
diff --git a/...essing/pre-train I/Pre-train I ver.2.pptx → ...dings/Basic Encodings and Embeddings.pptx b/...essing/pre-train I/Pre-train I ver.2.pptx → ...dings/Basic Encodings and Embeddings.pptx
diff --git a/...ocessing/pre-train I/Embeddings_way.ipynb → ...dings and Embeddings/Embeddings_way.ipynb b/...ocessing/pre-train I/Embeddings_way.ipynb → ...dings and Embeddings/Embeddings_way.ipynb
diff --git a/requirements.txt b/requirements.txt
@@ -5,4 +5,4 @@ tqdm
 nltk
 gensim
 jupyter
-
+torchsummary
-Original file line number
+Diff line change
@@ Expand Up / @@ -5,4 +5,4 @@ tqdm @@
     nltk
     gensim
     jupyter
+    torchsummary