Unseal - Mechanistic Interpretability for Transformers

Prerequisites

Unseal requires python 3.6+.

Installation

For its visualizations interfaces, Unseal uses this fork of the PySvelte library, which can be installed via pip:

git clone git@github.com:TomFrederik/PySvelte.git
cd PySvelte
pip install -e .

In order to run PySvelte, you will also need to install npm via your package manager. The hooking functionality of Unseal should still work without PySvelte, but we can't give any guarantees

Install Unseal via pip

pip install unseal

Usage

We refer to our documentation for tutorials and usage guides:

Documentation

Notebooks

Here are some notebooks that also showcase Unseal's functionalities.