experiment links transformer

vpj · vpj · commit ee5a34aa598a · 2022-06-28T19:02:20.000+05:30
diff --git a/docs/sitemap.xml b/docs/sitemap.xml
@@ -239,7 +239,7 @@
 
     <url>
       <loc>https://nn.labml.ai/experiments/nlp_autoregression.html</loc>
-      <lastmod>2022-06-25T16:30:00+00:00</lastmod>
+      <lastmod>2022-06-27T16:30:00+00:00</lastmod>
       <priority>1.00</priority>
     </url>
     
diff --git a/docs/transformers/basic/autoregressive_experiment.html b/docs/transformers/basic/autoregressive_experiment.html
diff --git a/docs/transformers/mha.html b/docs/transformers/mha.html
diff --git a/docs/transformers/models.html b/docs/transformers/models.html
diff --git a/labml_nn/transformers/basic/autoregressive_experiment.ipynb b/labml_nn/transformers/basic/autoregressive_experiment.ipynb
@@ -11,6 +11,7 @@
    "source": [
     "[![Github](https://img.shields.io/github/stars/labmlai/annotated_deep_learning_paper_implementations?style=social)](https://github.com/labmlai/annotated_deep_learning_paper_implementations)\n",
     "[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/labmlai/annotated_deep_learning_paper_implementations/blob/master/labml_nn/transformers/basic/autoregressive_experiment.ipynb)\n",
+    "[![Open In Comet](https://images.labml.ai/images/comet.svg?experiment=capsule_networks&file=model)](comet.ml/labml/transformer/ea8c108c2d94434ca3c2bc2b21015082)\n",
     "\n",
     "## Transformer Experiment\n",
     "\n",
diff --git a/labml_nn/transformers/basic/autoregressive_experiment.py b/labml_nn/transformers/basic/autoregressive_experiment.py
@@ -7,10 +7,11 @@
 
 # Transformer Auto-Regression Experiment
 
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/labmlai/annotated_deep_learning_paper_implementations/blob/master/labml_nn/transformers/basic/autoregressive_experiment.ipynb)
+[![Open In Comet](https://images.labml.ai/images/comet.svg?experiment=capsule_networks&file=model)](comet.ml/labml/transformer/ea8c108c2d94434ca3c2bc2b21015082)
+
 This trains a simple transformer introduced in [Attention Is All You Need](https://papers.labml.ai/paper/1706.03762)
 on an NLP auto-regression task (with Tiny Shakespeare dataset).
-
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/labmlai/annotated_deep_learning_paper_implementations/blob/master/labml_nn/transformers/basic/autoregressive_experiment.ipynb)
 """
 
 import torch
diff --git a/labml_nn/transformers/mha.py b/labml_nn/transformers/mha.py
@@ -8,6 +8,9 @@
 
 # Multi-Headed Attention (MHA)
 
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/labmlai/annotated_deep_learning_paper_implementations/blob/master/labml_nn/transformers/basic/autoregressive_experiment.ipynb)
+[![Open In Comet](https://images.labml.ai/images/comet.svg?experiment=capsule_networks&file=model)](comet.ml/labml/transformer/ea8c108c2d94434ca3c2bc2b21015082)
+
 This is a tutorial/implementation of multi-headed attention
 from paper [Attention Is All You Need](https://papers.labml.ai/paper/1706.03762)
 in [PyTorch](https://pytorch.org/).
@@ -17,8 +20,6 @@
 with MHA for NLP auto-regression.
 
 [Here is an experiment implementation](basic/autoregressive_experiment.html) that trains a simple transformer.
-
-[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/labmlai/annotated_deep_learning_paper_implementations/blob/master/labml_nn/transformers/basic/autoregressive_experiment.ipynb)
 """
 
 import math
diff --git a/labml_nn/transformers/models.py b/labml_nn/transformers/models.py
@@ -7,6 +7,9 @@
 ---
 
 # Transformer Encoder and Decoder Models
+
+[![Open In Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/labmlai/annotated_deep_learning_paper_implementations/blob/master/labml_nn/transformers/basic/autoregressive_experiment.ipynb)
+[![Open In Comet](https://images.labml.ai/images/comet.svg?experiment=capsule_networks&file=model)](comet.ml/labml/transformer/ea8c108c2d94434ca3c2bc2b21015082)
 """
 import math
 
diff --git a/setup.py b/setup.py
@@ -5,7 +5,7 @@
 
 setuptools.setup(
     name='labml-nn',
-    version='0.4.125',
+    version='0.4.126',
     author="Varuna Jayasiri, Nipun Wijerathne",
     author_email="vpjayasiri@gmail.com, hnipun@gmail.com",
     description="🧑‍🏫 Implementations/tutorials of deep learning papers with side-by-side notes 📝; including transformers (original, xl, switch, feedback, vit), optimizers (adam, radam, adabelief), gans(dcgan, cyclegan, stylegan2), 🎮 reinforcement learning (ppo, dqn), capsnet, distillation, etc. 🧠",
