Skip to content

Fix key and value heads patching for models with different n_heads from n_key_value_heads#981

Merged
jlarson4 merged 5 commits intoTransformerLensOrg:devfrom
nikolaystanishev:patching_key_value_heads_bug
Jan 20, 2026
Merged

Fix key and value heads patching for models with different n_heads from n_key_value_heads#981
jlarson4 merged 5 commits intoTransformerLensOrg:devfrom
nikolaystanishev:patching_key_value_heads_bug

Commits

Commits on Jun 12, 2025

Commits on Jun 19, 2025

Commits on Jul 9, 2025

Commits on Jul 25, 2025