Skip to content

Fix key and value heads patching for models with different n_heads from n_key_value_heads #981

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
jlarson4 merged 5 commits into from
Jan 20, 2026

Update doc string

f5efadf
Select commit
Loading
Failed to load commit list.
Sign in for the full log view
Merged

Fix key and value heads patching for models with different n_heads from n_key_value_heads #981

Update doc string
f5efadf
Select commit
Loading
Failed to load commit list.

The logs for this run have expired and are no longer available.