added decoder only transformer in jax

saurabhaloneai · Oct 8, 2024 · e0930c3 · e0930c3
1 parent 914d79a
commit e0930c3
Showing 1 changed file with 9 additions and 0 deletions.
diff --git a/04-transformers/01-transformer/transformer.ipynb b/04-transformers/01-transformer/transformer.ipynb
@@ -219,6 +219,15 @@
     "**explanation:** this converts the decoder's output into probabilities over the vocabulary for each position in the output sequence.\n"
    ]
   },
+  {
+   "cell_type": "markdown",
+   "metadata": {},
+   "source": [
+    "# code \n",
+    "\n",
+    "i will be coding the transformer decoder only model in jax "
+   ]
+  },
   {
    "cell_type": "code",
    "execution_count": null,