You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Add support for GPTQ-quantized MoE models using MoE Marlin#2557
Merged
danieldk merged 1 commit intomainhuggingface/text-generation-inference:mainfrom feature/moe-marlinhuggingface/text-generation-inference:feature/moe-marlinCopy head branch name to clipboardSep 30, 2024