Search results

ScatterMoE Gradient Norm Needs to be Properly Computed When Used With FSDP

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#109 In foundation-model-stack/fms-acceleration;

· fabianlim opened on Nov 11, 2024

Slow down observed for BigCode Santa Coder

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

questionFurther information is requestedFurther information is requested

Status: Open.

#110 In foundation-model-stack/fms-acceleration;

· fabianlim opened on Nov 13, 2024

Numba JIT TypingErrors Thrown on Multipack Functions

bugSomething isn't workingSomething isn't working

questionFurther information is requestedFurther information is requested

Status: Open.

#100 In foundation-model-stack/fms-acceleration;

· fabianlim opened on Nov 6, 2024

Logic Inconsistency In ScatterMoE during Expert Parallel

bugSomething isn't workingSomething isn't working

help wantedExtra attention is neededExtra attention is needed

Status: Open.

#121 In foundation-model-stack/fms-acceleration;

· fabianlim opened on Jan 24, 2025