Skip to content
#

self-attention-implementation

Star

Here are 4 public repositories matching this topic...

Language: Python
Filter by language
All 8 Jupyter Notebook 4 Python 4

ranfysvalle02 / ai-self-attention

Star 4

This repository provides a basic implementation of self-attention. The code demonstrates how attention mechanisms work in predicting the next word in a sequence. It's a basic implementation that demonstrates the core concept of attention but lacks the complexity of more advanced models like Transformers.

python machine-learning ml python3 rnn attention-mechanism rnn-model attention-is-all-you-need self-attentive-rnn self-attention transformer-architecture self-attention-implementation
  • Updated Sep 23, 2024
  • Python

sumony2j / SeedGPT

Star 1

SeedGPT is a minimal decoder-only LLM from scratch, inspired by andrej karpathy's tutorials, generating text token-by-token based on input word prompts.

python training education natural-language-processing deep-learning decoder inference text-generation pytorch artificial-intelligence transformer scratch implementation language-model andrej-karpathy self-attention-implementation llm chatgpt gpt-from-scratch seedgpt
  • Updated Aug 15, 2025
  • Python

Improve this page

Add a description, image, and links to the self-attention-implementation topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the self-attention-implementation topic, visit your repo's landing page and select "manage topics."

Learn more