Skip to content

Commit 8ac9fec

Browse files
author
Varun
committed
fix _moe_permute typing
Signed-off-by: Varun <vsundarr@redhat.com>
1 parent 00aa897 commit 8ac9fec

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

vllm/model_executor/layers/fused_moe/moe_permute_unpermute.py

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -18,7 +18,7 @@ def _moe_permute(
1818
expert_map: Optional[torch.Tensor],
1919
block_m: int,
2020
) -> tuple[torch.Tensor, Optional[torch.Tensor], torch.Tensor, torch.Tensor,
21-
Optional[torch.Tensor]]:
21+
torch.Tensor]:
2222
"""
2323
Determine the sorted_token_ids, expert_ids for the given problem size.
2424
Permute the hidden states and scales according to `sorted_token_ids`.

0 commit comments

Comments
 (0)