Fused MoE Kernel vs Grouped GEMM

[dywsjtu]

vLLM implemented a fused kernel for MoE expert layers. I also noticed that grouped GEMM has already been supported in cutlass. Here is an existing toy example of grouped GEMM in triton. I am curious what the design choice behind it to pick the fused kernel direction.