tuyishime / an-neuron-curiosity Public

forked from UFO-101/an-neuron

Notifications You must be signed in to change notification settings
Fork 0
Star 0

I got amazed by the write up (https://clementneo.com/posts/2023/02/11/we-found-an-neuron) explaining about finding a neuron that predicts ' a', and ' an' as normally, the prediction would depend on the following word. However, GPT only predicts a single word at a time. The purpose is to revisit this work after learning about Transformer architectu

0 stars 2 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 23 Commits
.gitignore		.gitignore
README.md		README.md
an_neuron_investigation.ipynb		an_neuron_investigation.ipynb
requirements.txt		requirements.txt

Repository files navigation

An neuron

Open In Colab

This repo contains code to reproduce the results of the blog post We Found An Neuron in GPT-2.

About

I got amazed by the write up (https://clementneo.com/posts/2023/02/11/we-found-an-neuron) explaining about finding a neuron that predicts ' a', and ' an' as normally, the prediction would depend on the following word. However, GPT only predicts a single word at a time. The purpose is to revisit this work after learning about Transformer architectu

Report repository

Releases

No releases published

Packages

No packages published

Languages

Jupyter Notebook 100.0%