Skip to content

Fix ffn_down quantization mix for MoE models#4927

Merged
ikawrakow merged 3 commits intomasterfrom
ik/fix_qxm_moe
Jan 14, 2024
Merged

Fix ffn_down quantization mix for MoE models#4927
ikawrakow merged 3 commits intomasterfrom
ik/fix_qxm_moe

Commits

Commits on Jan 14, 2024