Skip to content

Expected L0 Loss Regularization for Sparse Autoencoders

License

Notifications You must be signed in to change notification settings

joelburget/sae_expected_l0

Repository files navigation

Running

> wandb sweep --project sae-expected-l0-sweep-norm gpt2-config.yaml
> wandb agent --count 10 <sweep id printed by previous command>

If you have more GPU memory:

> wandb sweep --project sae-expected-l0-sweep-norm gemma-config.yaml

About

Expected L0 Loss Regularization for Sparse Autoencoders

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published